2023-02-08 02:55:04,550 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-02-08 02:55:04,743 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511 2023-02-08 02:55:04,756 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-02-08 02:55:04,756 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/cluster_1ef4d685-639e-f899-0aba-3988a080901f, deleteOnExit=true 2023-02-08 02:55:04,756 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-08 02:55:04,757 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/test.cache.data in system properties and HBase conf 2023-02-08 02:55:04,757 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/hadoop.tmp.dir in system properties and HBase conf 2023-02-08 02:55:04,758 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/hadoop.log.dir in system properties and HBase conf 2023-02-08 02:55:04,758 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-08 02:55:04,759 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-08 02:55:04,759 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-08 02:55:04,852 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-08 02:55:05,155 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-08 02:55:05,159 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-08 02:55:05,159 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-08 02:55:05,159 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-08 02:55:05,160 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 02:55:05,160 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-08 02:55:05,160 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-08 02:55:05,161 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 02:55:05,161 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 02:55:05,161 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-08 02:55:05,162 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/nfs.dump.dir in system properties and HBase conf 2023-02-08 02:55:05,162 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/java.io.tmpdir in system properties and HBase conf 2023-02-08 02:55:05,163 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 02:55:05,163 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-08 02:55:05,163 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-08 02:55:05,552 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 02:55:05,555 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 02:55:06,036 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-08 02:55:06,167 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-08 02:55:06,180 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 02:55:06,209 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 02:55:06,235 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/java.io.tmpdir/Jetty_localhost_localdomain_38389_hdfs____.vyzxvb/webapp 2023-02-08 02:55:06,335 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:38389 2023-02-08 02:55:06,367 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 02:55:06,368 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 02:55:06,996 WARN [Listener at localhost.localdomain/37451] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 02:55:07,072 WARN [Listener at localhost.localdomain/37451] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 02:55:07,088 WARN [Listener at localhost.localdomain/37451] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 02:55:07,094 INFO [Listener at localhost.localdomain/37451] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 02:55:07,098 INFO [Listener at localhost.localdomain/37451] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/java.io.tmpdir/Jetty_localhost_39033_datanode____h6upg1/webapp 2023-02-08 02:55:07,178 INFO [Listener at localhost.localdomain/37451] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39033 2023-02-08 02:55:07,460 WARN [Listener at localhost.localdomain/44017] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 02:55:08,476 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc8526d337cb6783e: Processing first storage report for DS-923c4f97-702d-4d66-8ed8-095acac1aa38 from datanode 933f9c55-c7d6-4679-9957-54bb32976647 2023-02-08 02:55:08,478 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc8526d337cb6783e: from storage DS-923c4f97-702d-4d66-8ed8-095acac1aa38 node DatanodeRegistration(127.0.0.1:33321, datanodeUuid=933f9c55-c7d6-4679-9957-54bb32976647, infoPort=43041, infoSecurePort=0, ipcPort=44017, storageInfo=lv=-57;cid=testClusterID;nsid=1327045542;c=1675824905611), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-08 02:55:08,478 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc8526d337cb6783e: Processing first storage report for DS-b158291c-e907-456f-81f1-bfbe08f661ff from datanode 933f9c55-c7d6-4679-9957-54bb32976647 2023-02-08 02:55:08,478 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc8526d337cb6783e: from storage DS-b158291c-e907-456f-81f1-bfbe08f661ff node DatanodeRegistration(127.0.0.1:33321, datanodeUuid=933f9c55-c7d6-4679-9957-54bb32976647, infoPort=43041, infoSecurePort=0, ipcPort=44017, storageInfo=lv=-57;cid=testClusterID;nsid=1327045542;c=1675824905611), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 02:55:08,488 DEBUG [Listener at localhost.localdomain/44017] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511 2023-02-08 02:55:08,547 INFO [Listener at localhost.localdomain/44017] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/cluster_1ef4d685-639e-f899-0aba-3988a080901f/zookeeper_0, clientPort=49602, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/cluster_1ef4d685-639e-f899-0aba-3988a080901f/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/cluster_1ef4d685-639e-f899-0aba-3988a080901f/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-08 02:55:08,559 INFO [Listener at localhost.localdomain/44017] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49602 2023-02-08 02:55:08,567 INFO [Listener at localhost.localdomain/44017] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 02:55:08,569 INFO [Listener at localhost.localdomain/44017] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 02:55:09,189 INFO [Listener at localhost.localdomain/44017] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17 with version=8 2023-02-08 02:55:09,190 INFO [Listener at localhost.localdomain/44017] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/hbase-staging 2023-02-08 02:55:09,501 INFO [Listener at localhost.localdomain/44017] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-08 02:55:09,856 INFO [Listener at localhost.localdomain/44017] client.ConnectionUtils(127): master/jenkins-hbase12:0 server-side Connection retries=3 2023-02-08 02:55:09,881 INFO [Listener at localhost.localdomain/44017] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 02:55:09,881 INFO [Listener at localhost.localdomain/44017] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 02:55:09,881 INFO [Listener at localhost.localdomain/44017] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 02:55:09,882 INFO [Listener at localhost.localdomain/44017] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 02:55:09,882 INFO [Listener at localhost.localdomain/44017] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 02:55:09,994 INFO [Listener at localhost.localdomain/44017] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 02:55:10,053 DEBUG [Listener at localhost.localdomain/44017] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-08 02:55:10,128 INFO [Listener at localhost.localdomain/44017] ipc.NettyRpcServer(120): Bind to /136.243.104.168:43477 2023-02-08 02:55:10,136 INFO [Listener at localhost.localdomain/44017] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 02:55:10,138 INFO [Listener at localhost.localdomain/44017] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 02:55:10,155 INFO [Listener at localhost.localdomain/44017] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43477 connecting to ZooKeeper ensemble=127.0.0.1:49602 2023-02-08 02:55:10,312 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:434770x0, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 02:55:10,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:43477-0x101407e94630000 connected 2023-02-08 02:55:10,569 DEBUG [Listener at localhost.localdomain/44017] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 02:55:10,570 DEBUG [Listener at localhost.localdomain/44017] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 02:55:10,576 DEBUG [Listener at localhost.localdomain/44017] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 02:55:10,585 DEBUG [Listener at localhost.localdomain/44017] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43477 2023-02-08 02:55:10,585 DEBUG [Listener at localhost.localdomain/44017] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43477 2023-02-08 02:55:10,585 DEBUG [Listener at localhost.localdomain/44017] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43477 2023-02-08 02:55:10,586 DEBUG [Listener at localhost.localdomain/44017] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43477 2023-02-08 02:55:10,586 DEBUG [Listener at localhost.localdomain/44017] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43477 2023-02-08 02:55:10,591 INFO [Listener at localhost.localdomain/44017] master.HMaster(439): hbase.rootdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17, hbase.cluster.distributed=false 2023-02-08 02:55:10,652 INFO [Listener at localhost.localdomain/44017] client.ConnectionUtils(127): regionserver/jenkins-hbase12:0 server-side Connection retries=3 2023-02-08 02:55:10,653 INFO [Listener at localhost.localdomain/44017] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 02:55:10,653 INFO [Listener at localhost.localdomain/44017] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 02:55:10,653 INFO [Listener at localhost.localdomain/44017] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 02:55:10,653 INFO [Listener at localhost.localdomain/44017] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 02:55:10,653 INFO [Listener at localhost.localdomain/44017] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 02:55:10,657 INFO [Listener at localhost.localdomain/44017] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 02:55:10,660 INFO [Listener at localhost.localdomain/44017] ipc.NettyRpcServer(120): Bind to /136.243.104.168:44577 2023-02-08 02:55:10,662 INFO [Listener at localhost.localdomain/44017] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 02:55:10,667 DEBUG [Listener at localhost.localdomain/44017] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 02:55:10,668 INFO [Listener at localhost.localdomain/44017] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 02:55:10,670 INFO [Listener at localhost.localdomain/44017] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 02:55:10,672 INFO [Listener at localhost.localdomain/44017] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44577 connecting to ZooKeeper ensemble=127.0.0.1:49602 2023-02-08 02:55:10,682 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:445770x0, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 02:55:10,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44577-0x101407e94630001 connected 2023-02-08 02:55:10,683 DEBUG [Listener at localhost.localdomain/44017] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 02:55:10,684 DEBUG [Listener at localhost.localdomain/44017] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 02:55:10,685 DEBUG [Listener at localhost.localdomain/44017] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 02:55:10,686 DEBUG [Listener at localhost.localdomain/44017] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44577 2023-02-08 02:55:10,686 DEBUG [Listener at localhost.localdomain/44017] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44577 2023-02-08 02:55:10,686 DEBUG [Listener at localhost.localdomain/44017] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44577 2023-02-08 02:55:10,687 DEBUG [Listener at localhost.localdomain/44017] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44577 2023-02-08 02:55:10,689 DEBUG [Listener at localhost.localdomain/44017] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44577 2023-02-08 02:55:10,691 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase12.apache.org,43477,1675824909306 2023-02-08 02:55:10,712 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 02:55:10,714 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase12.apache.org,43477,1675824909306 2023-02-08 02:55:10,745 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 02:55:10,745 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 02:55:10,745 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 02:55:10,746 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 02:55:10,747 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase12.apache.org,43477,1675824909306 from backup master directory 2023-02-08 02:55:10,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 02:55:10,756 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase12.apache.org,43477,1675824909306 2023-02-08 02:55:10,756 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 02:55:10,757 WARN [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 02:55:10,757 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase12.apache.org,43477,1675824909306 2023-02-08 02:55:10,760 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-08 02:55:10,762 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-08 02:55:11,242 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/hbase.id with ID: 5860dc1b-53c1-4b60-8e7e-c46d7c708d7d 2023-02-08 02:55:11,288 INFO [master/jenkins-hbase12:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 02:55:11,345 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 02:55:11,792 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x547dc463 to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:55:11,867 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@448af7ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:55:11,886 INFO [master/jenkins-hbase12:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 02:55:11,889 INFO [master/jenkins-hbase12:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-08 02:55:11,905 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-08 02:55:11,905 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-08 02:55:11,908 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-08 02:55:11,912 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-08 02:55:11,913 INFO [master/jenkins-hbase12:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 02:55:11,940 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/MasterData/data/master/store-tmp 2023-02-08 02:55:11,965 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:55:11,966 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 02:55:11,966 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 02:55:11,966 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 02:55:11,966 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 02:55:11,966 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 02:55:11,967 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 02:55:11,967 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675824911965Disabling compacts and flushes for region at 1675824911966 (+1 ms)Disabling writes for close at 1675824911966Writing region close event to WAL at 1675824911967 (+1 ms)Closed at 1675824911967 2023-02-08 02:55:11,968 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/MasterData/WALs/jenkins-hbase12.apache.org,43477,1675824909306 2023-02-08 02:55:11,988 INFO [master/jenkins-hbase12:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase12.apache.org%2C43477%2C1675824909306, suffix=, logDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/MasterData/WALs/jenkins-hbase12.apache.org,43477,1675824909306, archiveDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/MasterData/oldWALs, maxLogs=10 2023-02-08 02:55:12,042 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33321,DS-923c4f97-702d-4d66-8ed8-095acac1aa38,DISK] 2023-02-08 02:55:12,051 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-08 02:55:12,103 INFO [master/jenkins-hbase12:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/MasterData/WALs/jenkins-hbase12.apache.org,43477,1675824909306/jenkins-hbase12.apache.org%2C43477%2C1675824909306.1675824911996 2023-02-08 02:55:12,104 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33321,DS-923c4f97-702d-4d66-8ed8-095acac1aa38,DISK]] 2023-02-08 02:55:12,104 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-08 02:55:12,105 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:55:12,108 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 02:55:12,108 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 02:55:12,163 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-08 02:55:12,169 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-08 02:55:12,189 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-08 02:55:12,200 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:55:12,205 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 02:55:12,207 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 02:55:12,221 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 02:55:12,225 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:55:12,226 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74641321, jitterRate=0.11224235594272614}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 02:55:12,227 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675824912136Initializing all the Stores at 1675824912138 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675824912138Cleaning up temporary data from old regions at 1675824912212 (+74 ms)Cleaning up detritus from prior splits at 1675824912213 (+1 ms)Region opened successfully at 1675824912227 (+14 ms) 2023-02-08 02:55:12,228 INFO [master/jenkins-hbase12:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-08 02:55:12,246 INFO [master/jenkins-hbase12:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-08 02:55:12,246 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-08 02:55:12,247 INFO [master/jenkins-hbase12:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-08 02:55:12,249 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-08 02:55:12,274 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 24 msec 2023-02-08 02:55:12,274 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-08 02:55:12,298 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-08 02:55:12,303 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-08 02:55:12,325 INFO [master/jenkins-hbase12:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-08 02:55:12,328 INFO [master/jenkins-hbase12:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-08 02:55:12,330 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-08 02:55:12,335 INFO [master/jenkins-hbase12:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-08 02:55:12,339 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-08 02:55:12,387 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 02:55:12,389 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-08 02:55:12,389 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-08 02:55:12,399 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-08 02:55:12,408 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 02:55:12,408 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 02:55:12,409 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 02:55:12,409 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase12.apache.org,43477,1675824909306, sessionid=0x101407e94630000, setting cluster-up flag (Was=false) 2023-02-08 02:55:12,440 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 02:55:12,472 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-08 02:55:12,473 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase12.apache.org,43477,1675824909306 2023-02-08 02:55:12,492 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 02:55:12,524 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-08 02:55:12,526 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase12.apache.org,43477,1675824909306 2023-02-08 02:55:12,529 WARN [master/jenkins-hbase12:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.hbase-snapshot/.tmp 2023-02-08 02:55:12,594 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(952): ClusterId : 5860dc1b-53c1-4b60-8e7e-c46d7c708d7d 2023-02-08 02:55:12,597 DEBUG [RS:0;jenkins-hbase12:44577] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 02:55:12,610 DEBUG [RS:0;jenkins-hbase12:44577] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 02:55:12,610 DEBUG [RS:0;jenkins-hbase12:44577] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 02:55:12,620 DEBUG [RS:0;jenkins-hbase12:44577] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 02:55:12,621 DEBUG [RS:0;jenkins-hbase12:44577] zookeeper.ReadOnlyZKClient(139): Connect 0x58fb6561 to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:55:12,624 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-08 02:55:12,630 DEBUG [RS:0;jenkins-hbase12:44577] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@563c900e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:55:12,631 DEBUG [RS:0;jenkins-hbase12:44577] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52030e11, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase12.apache.org/136.243.104.168:0 2023-02-08 02:55:12,634 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase12:0, corePoolSize=5, maxPoolSize=5 2023-02-08 02:55:12,634 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase12:0, corePoolSize=5, maxPoolSize=5 2023-02-08 02:55:12,634 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase12:0, corePoolSize=5, maxPoolSize=5 2023-02-08 02:55:12,634 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase12:0, corePoolSize=5, maxPoolSize=5 2023-02-08 02:55:12,634 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase12:0, corePoolSize=10, maxPoolSize=10 2023-02-08 02:55:12,635 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-08 02:55:12,635 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase12:0, corePoolSize=2, maxPoolSize=2 2023-02-08 02:55:12,635 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-08 02:55:12,636 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675824942636 2023-02-08 02:55:12,638 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-08 02:55:12,642 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 02:55:12,642 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-08 02:55:12,647 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-08 02:55:12,648 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 02:55:12,653 DEBUG [RS:0;jenkins-hbase12:44577] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase12:44577 2023-02-08 02:55:12,654 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-08 02:55:12,654 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-08 02:55:12,655 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-08 02:55:12,655 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-08 02:55:12,655 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 02:55:12,657 INFO [RS:0;jenkins-hbase12:44577] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 02:55:12,657 INFO [RS:0;jenkins-hbase12:44577] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 02:55:12,657 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-08 02:55:12,657 DEBUG [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 02:55:12,659 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-08 02:55:12,659 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-08 02:55:12,660 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase12.apache.org,43477,1675824909306 with isa=jenkins-hbase12.apache.org/136.243.104.168:44577, startcode=1675824910652 2023-02-08 02:55:12,661 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-08 02:55:12,662 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-08 02:55:12,664 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.large.0-1675824912663,5,FailOnTimeoutGroup] 2023-02-08 02:55:12,665 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.small.0-1675824912664,5,FailOnTimeoutGroup] 2023-02-08 02:55:12,665 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 02:55:12,665 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-08 02:55:12,666 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-08 02:55:12,666 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-08 02:55:12,677 DEBUG [RS:0;jenkins-hbase12:44577] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 02:55:12,717 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:45853, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 02:55:12,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.ServerManager(394): Registering regionserver=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:12,740 DEBUG [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17 2023-02-08 02:55:12,741 DEBUG [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:37451 2023-02-08 02:55:12,741 DEBUG [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 02:55:12,756 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 02:55:12,756 DEBUG [RS:0;jenkins-hbase12:44577] zookeeper.ZKUtil(162): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:12,757 WARN [RS:0;jenkins-hbase12:44577] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 02:55:12,758 INFO [RS:0;jenkins-hbase12:44577] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 02:55:12,758 DEBUG [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/WALs/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:12,759 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase12.apache.org,44577,1675824910652] 2023-02-08 02:55:12,769 DEBUG [RS:0;jenkins-hbase12:44577] zookeeper.ZKUtil(162): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:12,778 DEBUG [RS:0;jenkins-hbase12:44577] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 02:55:12,785 INFO [RS:0;jenkins-hbase12:44577] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 02:55:12,802 INFO [RS:0;jenkins-hbase12:44577] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 02:55:12,804 INFO [RS:0;jenkins-hbase12:44577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 02:55:12,805 INFO [RS:0;jenkins-hbase12:44577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 02:55:12,806 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 02:55:12,811 INFO [RS:0;jenkins-hbase12:44577] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-02-08 02:55:12,811 DEBUG [RS:0;jenkins-hbase12:44577] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-08 02:55:12,812 DEBUG [RS:0;jenkins-hbase12:44577] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-08 02:55:12,812 DEBUG [RS:0;jenkins-hbase12:44577] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-08 02:55:12,812 DEBUG [RS:0;jenkins-hbase12:44577] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-08 02:55:12,812 DEBUG [RS:0;jenkins-hbase12:44577] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-08 02:55:12,812 DEBUG [RS:0;jenkins-hbase12:44577] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase12:0, corePoolSize=2, maxPoolSize=2 2023-02-08 02:55:12,812 DEBUG [RS:0;jenkins-hbase12:44577] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-08 02:55:12,813 DEBUG [RS:0;jenkins-hbase12:44577] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-08 02:55:12,813 DEBUG [RS:0;jenkins-hbase12:44577] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-08 02:55:12,813 DEBUG [RS:0;jenkins-hbase12:44577] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-08 02:55:12,814 INFO [RS:0;jenkins-hbase12:44577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 02:55:12,814 INFO [RS:0;jenkins-hbase12:44577] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 02:55:12,814 INFO [RS:0;jenkins-hbase12:44577] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 02:55:12,828 INFO [RS:0;jenkins-hbase12:44577] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 02:55:12,831 INFO [RS:0;jenkins-hbase12:44577] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,44577,1675824910652-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 02:55:12,843 INFO [RS:0;jenkins-hbase12:44577] regionserver.Replication(203): jenkins-hbase12.apache.org,44577,1675824910652 started 2023-02-08 02:55:12,843 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(1638): Serving as jenkins-hbase12.apache.org,44577,1675824910652, RpcServer on jenkins-hbase12.apache.org/136.243.104.168:44577, sessionid=0x101407e94630001 2023-02-08 02:55:12,844 DEBUG [RS:0;jenkins-hbase12:44577] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 02:55:12,844 DEBUG [RS:0;jenkins-hbase12:44577] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:12,844 DEBUG [RS:0;jenkins-hbase12:44577] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase12.apache.org,44577,1675824910652' 2023-02-08 02:55:12,844 DEBUG [RS:0;jenkins-hbase12:44577] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:12,844 DEBUG [RS:0;jenkins-hbase12:44577] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:12,845 DEBUG [RS:0;jenkins-hbase12:44577] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 02:55:12,845 DEBUG [RS:0;jenkins-hbase12:44577] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 02:55:12,845 DEBUG [RS:0;jenkins-hbase12:44577] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:12,845 DEBUG [RS:0;jenkins-hbase12:44577] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase12.apache.org,44577,1675824910652' 2023-02-08 02:55:12,845 DEBUG [RS:0;jenkins-hbase12:44577] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 02:55:12,846 DEBUG [RS:0;jenkins-hbase12:44577] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 02:55:12,846 DEBUG [RS:0;jenkins-hbase12:44577] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 02:55:12,846 INFO [RS:0;jenkins-hbase12:44577] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 02:55:12,846 INFO [RS:0;jenkins-hbase12:44577] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 02:55:12,961 INFO [RS:0;jenkins-hbase12:44577] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase12.apache.org%2C44577%2C1675824910652, suffix=, logDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/WALs/jenkins-hbase12.apache.org,44577,1675824910652, archiveDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/oldWALs, maxLogs=32 2023-02-08 02:55:12,978 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33321,DS-923c4f97-702d-4d66-8ed8-095acac1aa38,DISK] 2023-02-08 02:55:12,981 INFO [RS:0;jenkins-hbase12:44577] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/WALs/jenkins-hbase12.apache.org,44577,1675824910652/jenkins-hbase12.apache.org%2C44577%2C1675824910652.1675824912964 2023-02-08 02:55:12,981 DEBUG [RS:0;jenkins-hbase12:44577] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33321,DS-923c4f97-702d-4d66-8ed8-095acac1aa38,DISK]] 2023-02-08 02:55:13,082 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 02:55:13,083 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 02:55:13,083 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17 2023-02-08 02:55:13,103 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:55:13,107 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 02:55:13,111 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/info 2023-02-08 02:55:13,112 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 02:55:13,113 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:55:13,114 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 02:55:13,116 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/rep_barrier 2023-02-08 02:55:13,116 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 02:55:13,117 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:55:13,117 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 02:55:13,119 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/table 2023-02-08 02:55:13,120 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 02:55:13,120 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:55:13,122 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740 2023-02-08 02:55:13,122 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740 2023-02-08 02:55:13,126 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 02:55:13,128 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 02:55:13,131 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:55:13,132 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64298325, jitterRate=-0.0418802946805954}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 02:55:13,132 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675824913104Initializing all the Stores at 1675824913106 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675824913106Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675824913106Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675824913106Cleaning up temporary data from old regions at 1675824913124 (+18 ms)Cleaning up detritus from prior splits at 1675824913124Region opened successfully at 1675824913132 (+8 ms) 2023-02-08 02:55:13,132 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 02:55:13,132 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 02:55:13,132 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 02:55:13,132 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 02:55:13,132 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 02:55:13,133 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 02:55:13,133 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675824913132Disabling compacts and flushes for region at 1675824913132Disabling writes for close at 1675824913132Writing region close event to WAL at 1675824913133 (+1 ms)Closed at 1675824913133 2023-02-08 02:55:13,137 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 02:55:13,137 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-08 02:55:13,145 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-08 02:55:13,156 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-08 02:55:13,158 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-08 02:55:13,313 DEBUG [jenkins-hbase12:43477] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-02-08 02:55:13,319 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase12.apache.org,44577,1675824910652, state=OPENING 2023-02-08 02:55:13,366 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-08 02:55:13,377 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 02:55:13,378 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 02:55:13,382 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:55:13,569 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:13,571 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 02:55:13,574 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:60684, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 02:55:13,585 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-08 02:55:13,585 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 02:55:13,589 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase12.apache.org%2C44577%2C1675824910652.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/WALs/jenkins-hbase12.apache.org,44577,1675824910652, archiveDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/oldWALs, maxLogs=32 2023-02-08 02:55:13,606 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33321,DS-923c4f97-702d-4d66-8ed8-095acac1aa38,DISK] 2023-02-08 02:55:13,609 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/WALs/jenkins-hbase12.apache.org,44577,1675824910652/jenkins-hbase12.apache.org%2C44577%2C1675824910652.meta.1675824913591.meta 2023-02-08 02:55:13,610 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33321,DS-923c4f97-702d-4d66-8ed8-095acac1aa38,DISK]] 2023-02-08 02:55:13,610 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-08 02:55:13,611 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-08 02:55:13,626 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-08 02:55:13,630 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-08 02:55:13,634 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-08 02:55:13,634 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:55:13,635 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-08 02:55:13,635 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-08 02:55:13,637 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 02:55:13,639 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/info 2023-02-08 02:55:13,639 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/info 2023-02-08 02:55:13,639 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 02:55:13,640 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:55:13,640 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 02:55:13,642 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/rep_barrier 2023-02-08 02:55:13,642 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/rep_barrier 2023-02-08 02:55:13,643 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 02:55:13,643 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:55:13,644 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 02:55:13,645 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/table 2023-02-08 02:55:13,645 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/table 2023-02-08 02:55:13,646 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 02:55:13,647 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:55:13,649 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740 2023-02-08 02:55:13,652 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740 2023-02-08 02:55:13,655 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 02:55:13,657 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 02:55:13,659 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59767638, jitterRate=-0.10939279198646545}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 02:55:13,659 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675824913635Writing region info on filesystem at 1675824913635Initializing all the Stores at 1675824913637 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675824913637Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675824913637Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675824913637Cleaning up temporary data from old regions at 1675824913654 (+17 ms)Cleaning up detritus from prior splits at 1675824913654Running coprocessor post-open hooks at 1675824913659 (+5 ms)Region opened successfully at 1675824913659 2023-02-08 02:55:13,666 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675824913564 2023-02-08 02:55:13,682 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-08 02:55:13,683 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-08 02:55:13,683 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase12.apache.org,44577,1675824910652, state=OPEN 2023-02-08 02:55:13,692 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-08 02:55:13,692 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 02:55:13,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-08 02:55:13,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase12.apache.org,44577,1675824910652 in 310 msec 2023-02-08 02:55:13,703 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-08 02:55:13,703 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 554 msec 2023-02-08 02:55:13,708 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1380 sec 2023-02-08 02:55:13,708 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675824910732, completionTime=-1 2023-02-08 02:55:13,708 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-02-08 02:55:13,709 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-08 02:55:13,767 DEBUG [hconnection-0x25b3854c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 02:55:13,770 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:60694, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 02:55:13,786 INFO [master/jenkins-hbase12:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=1 2023-02-08 02:55:13,786 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675824973786 2023-02-08 02:55:13,786 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675825033786 2023-02-08 02:55:13,786 INFO [master/jenkins-hbase12:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 77 msec 2023-02-08 02:55:13,822 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,43477,1675824909306-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 02:55:13,822 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,43477,1675824909306-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 02:55:13,822 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,43477,1675824909306-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 02:55:13,824 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase12:43477, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 02:55:13,825 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-08 02:55:13,831 DEBUG [master/jenkins-hbase12:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-08 02:55:13,838 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-08 02:55:13,840 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 02:55:13,848 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-08 02:55:13,850 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 02:55:13,853 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 02:55:13,873 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/hbase/namespace/164106a360b9b3e7d8a5290e6f851c70 2023-02-08 02:55:13,875 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/hbase/namespace/164106a360b9b3e7d8a5290e6f851c70 empty. 2023-02-08 02:55:13,876 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/hbase/namespace/164106a360b9b3e7d8a5290e6f851c70 2023-02-08 02:55:13,876 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-08 02:55:14,301 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-08 02:55:14,305 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 164106a360b9b3e7d8a5290e6f851c70, NAME => 'hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp 2023-02-08 02:55:14,725 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:55:14,726 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 164106a360b9b3e7d8a5290e6f851c70, disabling compactions & flushes 2023-02-08 02:55:14,726 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70. 2023-02-08 02:55:14,726 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70. 2023-02-08 02:55:14,726 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70. after waiting 0 ms 2023-02-08 02:55:14,726 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70. 2023-02-08 02:55:14,726 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70. 2023-02-08 02:55:14,726 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 164106a360b9b3e7d8a5290e6f851c70: Waiting for close lock at 1675824914725Disabling compacts and flushes for region at 1675824914725Disabling writes for close at 1675824914726 (+1 ms)Writing region close event to WAL at 1675824914726Closed at 1675824914726 2023-02-08 02:55:14,734 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 02:55:14,751 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675824914738"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675824914738"}]},"ts":"1675824914738"} 2023-02-08 02:55:14,773 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 02:55:14,775 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 02:55:14,780 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675824914775"}]},"ts":"1675824914775"} 2023-02-08 02:55:14,784 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-08 02:55:14,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=164106a360b9b3e7d8a5290e6f851c70, ASSIGN}] 2023-02-08 02:55:14,920 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=164106a360b9b3e7d8a5290e6f851c70, ASSIGN 2023-02-08 02:55:14,922 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=164106a360b9b3e7d8a5290e6f851c70, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=false 2023-02-08 02:55:15,074 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=164106a360b9b3e7d8a5290e6f851c70, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:15,075 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675824915073"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675824915073"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675824915073"}]},"ts":"1675824915073"} 2023-02-08 02:55:15,084 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 164106a360b9b3e7d8a5290e6f851c70, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:55:15,252 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70. 2023-02-08 02:55:15,253 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 164106a360b9b3e7d8a5290e6f851c70, NAME => 'hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70.', STARTKEY => '', ENDKEY => ''} 2023-02-08 02:55:15,254 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 164106a360b9b3e7d8a5290e6f851c70 2023-02-08 02:55:15,254 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:55:15,254 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 164106a360b9b3e7d8a5290e6f851c70 2023-02-08 02:55:15,254 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 164106a360b9b3e7d8a5290e6f851c70 2023-02-08 02:55:15,257 INFO [StoreOpener-164106a360b9b3e7d8a5290e6f851c70-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 164106a360b9b3e7d8a5290e6f851c70 2023-02-08 02:55:15,259 DEBUG [StoreOpener-164106a360b9b3e7d8a5290e6f851c70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/namespace/164106a360b9b3e7d8a5290e6f851c70/info 2023-02-08 02:55:15,259 DEBUG [StoreOpener-164106a360b9b3e7d8a5290e6f851c70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/namespace/164106a360b9b3e7d8a5290e6f851c70/info 2023-02-08 02:55:15,260 INFO [StoreOpener-164106a360b9b3e7d8a5290e6f851c70-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 164106a360b9b3e7d8a5290e6f851c70 columnFamilyName info 2023-02-08 02:55:15,260 INFO [StoreOpener-164106a360b9b3e7d8a5290e6f851c70-1] regionserver.HStore(310): Store=164106a360b9b3e7d8a5290e6f851c70/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:55:15,262 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/namespace/164106a360b9b3e7d8a5290e6f851c70 2023-02-08 02:55:15,263 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/namespace/164106a360b9b3e7d8a5290e6f851c70 2023-02-08 02:55:15,268 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 164106a360b9b3e7d8a5290e6f851c70 2023-02-08 02:55:15,271 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/namespace/164106a360b9b3e7d8a5290e6f851c70/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:55:15,272 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 164106a360b9b3e7d8a5290e6f851c70; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60301966, jitterRate=-0.10143068432807922}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 02:55:15,272 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 164106a360b9b3e7d8a5290e6f851c70: Running coprocessor pre-open hook at 1675824915254Writing region info on filesystem at 1675824915254Initializing all the Stores at 1675824915256 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675824915256Cleaning up temporary data from old regions at 1675824915264 (+8 ms)Cleaning up detritus from prior splits at 1675824915264Running coprocessor post-open hooks at 1675824915272 (+8 ms)Region opened successfully at 1675824915272 2023-02-08 02:55:15,274 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70., pid=6, masterSystemTime=1675824915239 2023-02-08 02:55:15,278 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70. 2023-02-08 02:55:15,278 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70. 2023-02-08 02:55:15,279 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=164106a360b9b3e7d8a5290e6f851c70, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:15,280 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675824915278"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675824915278"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675824915278"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675824915278"}]},"ts":"1675824915278"} 2023-02-08 02:55:15,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-08 02:55:15,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 164106a360b9b3e7d8a5290e6f851c70, server=jenkins-hbase12.apache.org,44577,1675824910652 in 201 msec 2023-02-08 02:55:15,291 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-08 02:55:15,291 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=164106a360b9b3e7d8a5290e6f851c70, ASSIGN in 370 msec 2023-02-08 02:55:15,293 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 02:55:15,293 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675824915293"}]},"ts":"1675824915293"} 2023-02-08 02:55:15,296 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-08 02:55:15,347 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 02:55:15,351 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.5070 sec 2023-02-08 02:55:15,352 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-08 02:55:15,363 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-08 02:55:15,363 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 02:55:15,402 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-08 02:55:15,429 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 02:55:15,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 129 msec 2023-02-08 02:55:15,537 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-08 02:55:15,576 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 02:55:15,593 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 54 msec 2023-02-08 02:55:15,619 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-08 02:55:15,640 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-08 02:55:15,640 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 4.883sec 2023-02-08 02:55:15,643 INFO [master/jenkins-hbase12:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-08 02:55:15,645 INFO [master/jenkins-hbase12:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-08 02:55:15,645 INFO [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-08 02:55:15,646 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,43477,1675824909306-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-08 02:55:15,648 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,43477,1675824909306-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-08 02:55:15,660 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-08 02:55:15,703 DEBUG [Listener at localhost.localdomain/44017] zookeeper.ReadOnlyZKClient(139): Connect 0x418632d5 to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:55:15,714 DEBUG [Listener at localhost.localdomain/44017] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bf9b76d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:55:15,730 DEBUG [hconnection-0x3584c3e6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 02:55:15,744 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:49660, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 02:55:15,753 INFO [Listener at localhost.localdomain/44017] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase12.apache.org,43477,1675824909306 2023-02-08 02:55:15,753 DEBUG [Listener at localhost.localdomain/44017] zookeeper.ReadOnlyZKClient(139): Connect 0x57d271f7 to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:55:15,767 DEBUG [Listener at localhost.localdomain/44017] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37d84738, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:55:15,767 INFO [Listener at localhost.localdomain/44017] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 02:55:15,789 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=210, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=234, ProcessCount=171, AvailableMemoryMB=3733 2023-02-08 02:55:15,793 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:15,793 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:15,800 DEBUG [Listener at localhost.localdomain/44017] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 02:55:15,804 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:37466, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 02:55:15,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-08 02:55:15,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:15,820 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 02:55:15,822 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 02:55:15,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-02-08 02:55:15,825 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b 2023-02-08 02:55:15,827 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b empty. 2023-02-08 02:55:15,829 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b 2023-02-08 02:55:15,829 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-02-08 02:55:15,833 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:15,834 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:15,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-08 02:55:15,845 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-08 02:55:15,848 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8e8a02a5b11b2ef4532598feeecb1f4b, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp 2023-02-08 02:55:15,859 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:55:15,859 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1603): Closing 8e8a02a5b11b2ef4532598feeecb1f4b, disabling compactions & flushes 2023-02-08 02:55:15,860 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:15,860 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:15,860 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. after waiting 0 ms 2023-02-08 02:55:15,860 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:15,860 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:15,860 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1557): Region close journal for 8e8a02a5b11b2ef4532598feeecb1f4b: Waiting for close lock at 1675824915859Disabling compacts and flushes for region at 1675824915859Disabling writes for close at 1675824915860 (+1 ms)Writing region close event to WAL at 1675824915860Closed at 1675824915860 2023-02-08 02:55:15,864 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 02:55:15,865 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675824915865"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675824915865"}]},"ts":"1675824915865"} 2023-02-08 02:55:15,868 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 02:55:15,869 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 02:55:15,870 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675824915870"}]},"ts":"1675824915870"} 2023-02-08 02:55:15,872 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-02-08 02:55:15,893 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=8e8a02a5b11b2ef4532598feeecb1f4b, ASSIGN}] 2023-02-08 02:55:15,895 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=8e8a02a5b11b2ef4532598feeecb1f4b, ASSIGN 2023-02-08 02:55:15,897 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=8e8a02a5b11b2ef4532598feeecb1f4b, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=false 2023-02-08 02:55:15,942 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:15,943 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:15,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-08 02:55:16,049 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=8e8a02a5b11b2ef4532598feeecb1f4b, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:16,050 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675824916049"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675824916049"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675824916049"}]},"ts":"1675824916049"} 2023-02-08 02:55:16,056 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 8e8a02a5b11b2ef4532598feeecb1f4b, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:55:16,146 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:16,146 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:16,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-08 02:55:16,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:16,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8e8a02a5b11b2ef4532598feeecb1f4b, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b.', STARTKEY => '', ENDKEY => ''} 2023-02-08 02:55:16,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 8e8a02a5b11b2ef4532598feeecb1f4b 2023-02-08 02:55:16,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:55:16,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 8e8a02a5b11b2ef4532598feeecb1f4b 2023-02-08 02:55:16,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 8e8a02a5b11b2ef4532598feeecb1f4b 2023-02-08 02:55:16,225 INFO [StoreOpener-8e8a02a5b11b2ef4532598feeecb1f4b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8e8a02a5b11b2ef4532598feeecb1f4b 2023-02-08 02:55:16,228 DEBUG [StoreOpener-8e8a02a5b11b2ef4532598feeecb1f4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1 2023-02-08 02:55:16,228 DEBUG [StoreOpener-8e8a02a5b11b2ef4532598feeecb1f4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1 2023-02-08 02:55:16,233 INFO [StoreOpener-8e8a02a5b11b2ef4532598feeecb1f4b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e8a02a5b11b2ef4532598feeecb1f4b columnFamilyName family1 2023-02-08 02:55:16,237 INFO [StoreOpener-8e8a02a5b11b2ef4532598feeecb1f4b-1] regionserver.HStore(310): Store=8e8a02a5b11b2ef4532598feeecb1f4b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:55:16,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b 2023-02-08 02:55:16,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b 2023-02-08 02:55:16,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 8e8a02a5b11b2ef4532598feeecb1f4b 2023-02-08 02:55:16,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:55:16,252 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 8e8a02a5b11b2ef4532598feeecb1f4b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64331414, jitterRate=-0.04138723015785217}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 02:55:16,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 8e8a02a5b11b2ef4532598feeecb1f4b: Running coprocessor pre-open hook at 1675824916220Writing region info on filesystem at 1675824916220Initializing all the Stores at 1675824916222 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675824916223 (+1 ms)Cleaning up temporary data from old regions at 1675824916243 (+20 ms)Cleaning up detritus from prior splits at 1675824916243Running coprocessor post-open hooks at 1675824916252 (+9 ms)Region opened successfully at 1675824916252 2023-02-08 02:55:16,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b., pid=11, masterSystemTime=1675824916211 2023-02-08 02:55:16,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:16,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:16,258 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=8e8a02a5b11b2ef4532598feeecb1f4b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:16,259 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675824916258"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675824916258"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675824916258"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675824916258"}]},"ts":"1675824916258"} 2023-02-08 02:55:16,266 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-08 02:55:16,266 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 8e8a02a5b11b2ef4532598feeecb1f4b, server=jenkins-hbase12.apache.org,44577,1675824910652 in 206 msec 2023-02-08 02:55:16,269 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-02-08 02:55:16,270 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=8e8a02a5b11b2ef4532598feeecb1f4b, ASSIGN in 373 msec 2023-02-08 02:55:16,271 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 02:55:16,271 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675824916271"}]},"ts":"1675824916271"} 2023-02-08 02:55:16,273 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-02-08 02:55:16,327 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 02:55:16,333 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 511 msec 2023-02-08 02:55:16,451 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:16,451 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:16,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-08 02:55:16,456 INFO [Listener at localhost.localdomain/44017] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-02-08 02:55:16,479 DEBUG [hconnection-0x79be2886-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 02:55:16,482 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:49664, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 02:55:16,614 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:16,614 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:16,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:16,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:16,625 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 02:55:16,625 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:16,625 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-08 02:55:16,625 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-08 02:55:16,626 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:16,626 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:16,713 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:16,714 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:16,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:16,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:16,715 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:16,715 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:16,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:16,716 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:16,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:16,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:16,719 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:16,723 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:16,723 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-08 02:55:16,724 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:16,725 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-08 02:55:16,725 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:16,725 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:16,725 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:16,726 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. started... 2023-02-08 02:55:16,728 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8e8a02a5b11b2ef4532598feeecb1f4b 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-08 02:55:17,298 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511301ffbf9e73e3149b39c5d01311961b6b9 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511301ffbf9e73e3149b39c5d01311961b6b9 2023-02-08 02:55:17,713 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp/family1/d91687e6128847c5a0e7a851806cd8ef 2023-02-08 02:55:17,730 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp/family1/d91687e6128847c5a0e7a851806cd8ef as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/d91687e6128847c5a0e7a851806cd8ef 2023-02-08 02:55:17,739 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/d91687e6128847c5a0e7a851806cd8ef, entries=1000, sequenceid=5, filesize=175.8 K 2023-02-08 02:55:17,741 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 8e8a02a5b11b2ef4532598feeecb1f4b in 1014ms, sequenceid=5, compaction requested=false 2023-02-08 02:55:17,743 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 02:55:17,745 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8e8a02a5b11b2ef4532598feeecb1f4b: 2023-02-08 02:55:17,745 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:17,745 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:17,745 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:17,745 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:17,746 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-08 02:55:17,746 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-08 02:55:17,808 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:17,808 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:17,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:17,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:17,808 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,808 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:17,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:17,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:17,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-08 02:55:17,811 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-08 02:55:17,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2629f5af[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:17,811 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,818 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,819 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-08 02:55:17,819 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-08 02:55:17,819 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:17,819 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:17,819 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:17,830 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-08 02:55:17,830 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:17,830 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:17,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:17,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:17,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:17,830 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-08 02:55:17,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:17,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:17,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:17,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:17,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:17,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:17,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-08 02:55:17,839 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-08 02:55:17,839 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:17,840 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:17,840 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,840 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:17,850 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,850 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:17,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:17,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,850 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:17,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:17,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:17,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:17,851 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:17,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:17,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,853 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:17,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:17,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:17,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:17,871 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:17,871 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:17,871 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:17,871 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:17,872 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:17,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:17,871 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 02:55:17,872 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:17,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:17,872 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,872 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,872 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:17,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:17,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:17,874 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:17,874 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:17,975 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:17,976 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:17,976 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:17,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:17,997 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:17,997 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:17,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:18,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:18,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:18,002 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 02:55:18,002 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:18,003 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-08 02:55:18,003 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-08 02:55:18,004 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:18,004 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:18,016 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:18,016 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:18,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:18,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:18,016 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:18,016 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:18,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:18,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:18,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:18,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:18,018 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:18,018 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-08 02:55:18,018 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:18,018 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-08 02:55:18,018 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:18,019 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-08 02:55:18,019 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:18,019 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:18,019 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:18,019 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. started... 2023-02-08 02:55:18,019 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8e8a02a5b11b2ef4532598feeecb1f4b 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-08 02:55:18,456 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284d3b0454bf934f05998b327d4a179bc9 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511284d3b0454bf934f05998b327d4a179bc9 2023-02-08 02:55:18,870 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp/family1/efcce8031cfe4b1cb0e363f7b97466e3 2023-02-08 02:55:18,887 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp/family1/efcce8031cfe4b1cb0e363f7b97466e3 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/efcce8031cfe4b1cb0e363f7b97466e3 2023-02-08 02:55:18,898 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/efcce8031cfe4b1cb0e363f7b97466e3, entries=1, sequenceid=9, filesize=5.0 K 2023-02-08 02:55:18,900 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 8e8a02a5b11b2ef4532598feeecb1f4b in 881ms, sequenceid=9, compaction requested=false 2023-02-08 02:55:18,900 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8e8a02a5b11b2ef4532598feeecb1f4b: 2023-02-08 02:55:18,900 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:18,900 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:18,901 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:18,901 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:18,901 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-08 02:55:18,901 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-08 02:55:18,966 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:18,966 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:18,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:18,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:18,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:18,967 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:18,967 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:18,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:18,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:18,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:18,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:18,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:18,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-08 02:55:18,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5327e910[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:18,973 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-08 02:55:18,973 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:18,987 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:18,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:18,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:18,988 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-08 02:55:18,988 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-08 02:55:18,988 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:18,988 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:18,988 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:19,028 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:19,028 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-08 02:55:19,029 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:19,029 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-08 02:55:19,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:19,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:19,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:19,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:19,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:19,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:19,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:19,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:19,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:19,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-08 02:55:19,041 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-08 02:55:19,041 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:19,041 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:19,041 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,041 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:19,060 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,061 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:19,061 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:19,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:19,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:19,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:19,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:19,062 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:19,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:19,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:19,065 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:19,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:19,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:19,079 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:19,079 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:19,079 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:19,079 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:19,079 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:19,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 02:55:19,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:19,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:19,079 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,080 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:19,080 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,080 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,080 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,080 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:19,080 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:19,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:19,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:19,166 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 02:55:19,181 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:19,181 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:19,181 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:19,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:19,189 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:19,189 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:19,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:19,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:19,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,193 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 02:55:19,193 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:19,193 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-08 02:55:19,193 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-08 02:55:19,194 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,194 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,206 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:19,206 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:19,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:19,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:19,206 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:19,206 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:19,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,207 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:19,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,207 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,208 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-08 02:55:19,208 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:19,208 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-08 02:55:19,208 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:19,208 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-08 02:55:19,208 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:19,208 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:19,208 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:19,209 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. started... 2023-02-08 02:55:19,209 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8e8a02a5b11b2ef4532598feeecb1f4b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:19,224 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-08 02:55:19,225 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-08 02:55:19,496 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 02:55:19,497 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-08 02:55:19,638 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201c32d62c0636a412fb735230ac549dacf to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201c32d62c0636a412fb735230ac549dacf 2023-02-08 02:55:20,058 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp/family1/5d3826e062db40c391d40f8ab282fe82 2023-02-08 02:55:20,078 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp/family1/5d3826e062db40c391d40f8ab282fe82 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/5d3826e062db40c391d40f8ab282fe82 2023-02-08 02:55:20,087 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/5d3826e062db40c391d40f8ab282fe82, entries=1, sequenceid=13, filesize=5.0 K 2023-02-08 02:55:20,088 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e8a02a5b11b2ef4532598feeecb1f4b in 879ms, sequenceid=13, compaction requested=true 2023-02-08 02:55:20,088 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8e8a02a5b11b2ef4532598feeecb1f4b: 2023-02-08 02:55:20,088 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:20,088 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:20,088 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:20,088 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:20,088 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-08 02:55:20,088 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-08 02:55:20,166 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:20,166 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:20,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:20,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:20,167 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,168 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:20,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:20,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:20,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:20,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:20,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-08 02:55:20,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bca0019[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:20,174 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-08 02:55:20,175 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,187 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,188 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-08 02:55:20,188 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-08 02:55:20,188 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:20,188 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:20,188 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:20,198 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-08 02:55:20,198 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:20,198 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:20,198 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-08 02:55:20,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:20,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:20,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:20,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:20,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:20,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:20,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:20,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:20,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:20,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-08 02:55:20,202 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-08 02:55:20,202 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:20,203 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:20,203 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,203 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:20,216 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,216 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,216 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:20,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:20,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:20,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:20,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:20,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:20,217 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:20,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:20,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:20,219 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:20,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:20,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:20,229 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:20,229 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:20,229 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:20,229 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:20,229 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:20,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 02:55:20,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:20,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:20,229 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,230 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:20,230 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,230 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,230 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,231 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:20,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:20,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:20,231 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:20,331 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:20,332 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:20,332 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:20,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:20,346 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:20,346 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:20,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:20,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:20,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,350 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 02:55:20,350 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:20,350 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-08 02:55:20,350 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-08 02:55:20,351 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,351 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,363 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:20,363 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:20,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:20,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:20,364 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:20,364 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:20,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:20,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,366 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,366 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-08 02:55:20,367 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:20,367 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-08 02:55:20,367 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:20,367 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-08 02:55:20,367 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:20,368 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:20,368 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:20,368 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. started... 2023-02-08 02:55:20,368 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8e8a02a5b11b2ef4532598feeecb1f4b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:20,809 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e95fb3bb56d247938ba6716143cf9163 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205e95fb3bb56d247938ba6716143cf9163 2023-02-08 02:55:21,223 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp/family1/f165b09aff7a4e9ba847e8fb9d37e22d 2023-02-08 02:55:21,240 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp/family1/f165b09aff7a4e9ba847e8fb9d37e22d as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/f165b09aff7a4e9ba847e8fb9d37e22d 2023-02-08 02:55:21,248 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/f165b09aff7a4e9ba847e8fb9d37e22d, entries=1, sequenceid=17, filesize=5.0 K 2023-02-08 02:55:21,250 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e8a02a5b11b2ef4532598feeecb1f4b in 882ms, sequenceid=17, compaction requested=true 2023-02-08 02:55:21,250 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8e8a02a5b11b2ef4532598feeecb1f4b: 2023-02-08 02:55:21,250 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:21,250 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:21,250 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:21,250 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:21,250 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-08 02:55:21,250 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-08 02:55:21,292 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:21,292 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:21,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:21,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:21,293 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,293 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:21,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:21,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:21,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:21,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:21,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-08 02:55:21,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75f4ed82[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:21,298 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-08 02:55:21,298 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,310 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,311 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-08 02:55:21,311 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-08 02:55:21,311 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:21,311 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:21,311 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:21,324 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-08 02:55:21,324 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:21,324 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:21,324 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-08 02:55:21,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:21,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:21,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:21,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:21,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:21,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:21,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-08 02:55:21,331 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-08 02:55:21,331 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:21,331 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:21,331 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,331 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:21,344 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,344 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,344 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:21,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:21,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:21,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:21,345 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:21,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:21,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:21,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:21,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,346 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:21,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:21,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:21,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:21,355 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:21,355 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:21,355 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,355 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:21,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:21,355 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:21,355 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:21,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 02:55:21,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:21,355 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:21,356 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-08 02:55:21,356 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:21,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:21,356 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,357 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:21,357 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,357 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:21,457 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:21,457 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:21,457 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:21,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:21,468 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:21,468 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:21,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:21,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:21,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,473 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 02:55:21,473 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:21,474 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-08 02:55:21,474 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-08 02:55:21,474 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,475 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,481 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:21,481 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:21,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:21,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:21,482 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:21,482 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:21,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,482 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:21,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,483 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,483 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-08 02:55:21,483 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:21,483 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-08 02:55:21,483 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:21,483 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-08 02:55:21,484 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:21,484 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:21,484 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:21,484 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. started... 2023-02-08 02:55:21,484 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8e8a02a5b11b2ef4532598feeecb1f4b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:21,917 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f814528fdb144a79a88a887c1ce4bf46 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228f814528fdb144a79a88a887c1ce4bf46 2023-02-08 02:55:22,330 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp/family1/78bf202287ce464b97c742fe1bd9f05e 2023-02-08 02:55:22,347 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp/family1/78bf202287ce464b97c742fe1bd9f05e as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/78bf202287ce464b97c742fe1bd9f05e 2023-02-08 02:55:22,355 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/78bf202287ce464b97c742fe1bd9f05e, entries=1, sequenceid=21, filesize=5.0 K 2023-02-08 02:55:22,356 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e8a02a5b11b2ef4532598feeecb1f4b in 872ms, sequenceid=21, compaction requested=true 2023-02-08 02:55:22,356 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8e8a02a5b11b2ef4532598feeecb1f4b: 2023-02-08 02:55:22,356 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:22,357 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:22,357 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:22,357 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:22,357 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-08 02:55:22,357 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-08 02:55:22,428 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:22,428 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:22,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:22,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:22,430 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,430 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:22,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:22,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:22,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:22,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:22,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-08 02:55:22,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c19ea1e[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:22,436 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-08 02:55:22,436 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,458 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,458 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-08 02:55:22,458 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-08 02:55:22,458 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:22,458 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:22,458 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:22,471 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-08 02:55:22,471 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:22,471 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-08 02:55:22,471 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:22,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:22,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:22,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:22,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:22,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:22,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:22,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:22,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:22,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:22,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-08 02:55:22,474 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-08 02:55:22,474 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:22,474 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:22,474 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,474 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:22,481 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,481 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:22,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:22,481 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:22,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:22,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:22,482 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:22,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:22,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:22,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:22,485 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:22,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:22,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:22,492 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:22,492 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,492 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:22,492 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:22,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:22,492 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:22,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 02:55:22,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:22,492 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:22,492 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:22,493 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,493 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:22,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:22,494 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,494 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:22,494 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:22,594 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:22,594 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:22,595 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:22,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:22,609 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:22,609 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:22,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:22,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:22,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,612 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 02:55:22,612 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:22,613 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-08 02:55:22,613 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-08 02:55:22,613 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,613 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,618 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:22,618 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:22,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:22,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:22,618 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:22,619 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:22,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,619 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:22,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,620 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,620 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-08 02:55:22,620 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:22,620 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-08 02:55:22,620 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:22,620 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-08 02:55:22,621 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:22,621 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:22,621 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:22,621 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. started... 2023-02-08 02:55:22,621 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8e8a02a5b11b2ef4532598feeecb1f4b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:23,054 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123107738912fd7548708a343e0783145865 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015123107738912fd7548708a343e0783145865 2023-02-08 02:55:23,464 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp/family1/59817d7994c74605b88b63199aab6524 2023-02-08 02:55:23,474 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp/family1/59817d7994c74605b88b63199aab6524 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/59817d7994c74605b88b63199aab6524 2023-02-08 02:55:23,484 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/59817d7994c74605b88b63199aab6524, entries=1, sequenceid=25, filesize=5.0 K 2023-02-08 02:55:23,486 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e8a02a5b11b2ef4532598feeecb1f4b in 865ms, sequenceid=25, compaction requested=true 2023-02-08 02:55:23,486 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8e8a02a5b11b2ef4532598feeecb1f4b: 2023-02-08 02:55:23,486 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:23,486 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:23,487 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:23,487 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:23,487 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-08 02:55:23,487 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-08 02:55:23,534 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:23,534 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:23,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:23,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:23,535 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,535 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:23,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:23,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:23,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:23,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:23,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-08 02:55:23,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@709aefe4[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:23,538 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-08 02:55:23,538 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,544 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,545 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-08 02:55:23,545 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-08 02:55:23,545 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:23,545 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:23,545 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:23,555 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:23,555 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-08 02:55:23,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:23,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:23,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:23,555 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:23,556 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-08 02:55:23,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:23,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:23,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:23,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:23,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:23,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:23,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-08 02:55:23,563 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-08 02:55:23,563 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:23,563 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:23,563 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,563 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:23,576 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,576 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:23,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:23,576 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:23,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:23,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:23,577 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:23,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:23,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:23,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:23,579 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:23,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:23,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:23,594 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:23,594 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:23,594 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:23,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:23,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 02:55:23,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:23,595 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,595 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:23,595 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:23,595 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:23,595 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:23,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:23,596 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:23,596 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,596 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:23,596 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,697 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:23,697 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:23,697 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:23,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:23,714 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:23,714 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:23,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:23,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:23,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,719 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 02:55:23,719 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:23,719 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-08 02:55:23,719 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-08 02:55:23,720 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,720 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,731 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:23,731 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:23,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:23,732 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:23,732 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,733 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:23,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,735 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,735 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-08 02:55:23,735 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:23,735 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-08 02:55:23,735 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:23,736 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-08 02:55:23,736 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:23,736 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:23,736 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:23,737 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. started... 2023-02-08 02:55:23,737 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8e8a02a5b11b2ef4532598feeecb1f4b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:24,168 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601016723b24369014b579600df152e43f2de to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601016723b24369014b579600df152e43f2de 2023-02-08 02:55:24,582 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp/family1/904bbf46a7b049038ffa40ec7a83364e 2023-02-08 02:55:24,597 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp/family1/904bbf46a7b049038ffa40ec7a83364e as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/904bbf46a7b049038ffa40ec7a83364e 2023-02-08 02:55:24,608 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/904bbf46a7b049038ffa40ec7a83364e, entries=1, sequenceid=29, filesize=5.0 K 2023-02-08 02:55:24,609 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e8a02a5b11b2ef4532598feeecb1f4b in 872ms, sequenceid=29, compaction requested=true 2023-02-08 02:55:24,610 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8e8a02a5b11b2ef4532598feeecb1f4b: 2023-02-08 02:55:24,610 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:24,610 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:24,611 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:24,611 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:24,611 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-08 02:55:24,611 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-08 02:55:24,850 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:24,850 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:24,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:24,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:24,851 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,851 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:24,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:24,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:24,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:24,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:24,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-08 02:55:24,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bfbf326[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:24,854 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-08 02:55:24,855 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,860 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,860 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-08 02:55:24,860 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-08 02:55:24,860 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:24,860 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:24,860 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:24,870 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:24,871 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-08 02:55:24,871 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:24,871 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-08 02:55:24,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:24,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:24,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:24,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:24,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:24,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:24,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:24,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:24,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:24,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-08 02:55:24,876 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-08 02:55:24,876 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:24,876 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:24,876 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,876 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:24,889 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,889 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:24,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:24,889 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:24,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:24,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:24,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:24,891 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:24,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:24,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:24,894 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:24,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:24,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:24,934 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:24,934 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:24,934 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:24,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 02:55:24,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:24,934 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:24,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:24,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-08 02:55:24,934 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:24,934 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,935 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:24,937 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:24,936 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:24,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:24,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:24,937 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,938 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:24,938 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,037 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:25,038 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:25,038 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:25,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:25,053 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:25,053 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:25,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:25,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:25,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,058 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 02:55:25,058 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:25,058 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-08 02:55:25,058 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-08 02:55:25,059 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,059 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,081 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:25,081 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:25,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:25,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:25,082 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:25,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,082 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:25,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:25,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,084 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,085 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-08 02:55:25,085 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,085 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-08 02:55:25,085 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:25,086 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-08 02:55:25,086 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:25,086 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:25,086 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:25,087 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. started... 2023-02-08 02:55:25,087 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8e8a02a5b11b2ef4532598feeecb1f4b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:25,512 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c1b10d8c91454455b003c8bfa6a72f91 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103c1b10d8c91454455b003c8bfa6a72f91 2023-02-08 02:55:25,922 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp/family1/3804b15b18b24b3c98e89b793e324285 2023-02-08 02:55:25,937 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp/family1/3804b15b18b24b3c98e89b793e324285 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/3804b15b18b24b3c98e89b793e324285 2023-02-08 02:55:25,945 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/3804b15b18b24b3c98e89b793e324285, entries=1, sequenceid=33, filesize=5.0 K 2023-02-08 02:55:25,946 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e8a02a5b11b2ef4532598feeecb1f4b in 859ms, sequenceid=33, compaction requested=true 2023-02-08 02:55:25,947 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8e8a02a5b11b2ef4532598feeecb1f4b: 2023-02-08 02:55:25,947 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:25,947 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:25,947 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:25,947 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:25,947 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-08 02:55:25,947 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-08 02:55:25,965 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,965 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:25,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:25,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:25,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:25,966 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,966 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:25,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:25,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:25,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:25,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:25,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-08 02:55:25,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9b19d26[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:25,968 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-08 02:55:25,968 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,976 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,976 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-08 02:55:25,976 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-08 02:55:25,976 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:25,976 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:25,976 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:25,986 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-08 02:55:25,986 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:25,986 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-08 02:55:25,986 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:25,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:25,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:25,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:25,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:25,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:25,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:25,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:25,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:25,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:25,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-08 02:55:25,991 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-08 02:55:25,991 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:25,991 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:25,991 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,991 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:25,997 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,997 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:25,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:25,997 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:25,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:25,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:25,998 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:25,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:25,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:25,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:25,999 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:25,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:26,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:26,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:26,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:26,007 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:26,007 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:26,007 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:26,007 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:26,007 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:26,008 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:26,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-08 02:55:26,008 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:26,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 02:55:26,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:26,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:26,008 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:26,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:26,008 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:26,009 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:26,009 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:26,009 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:26,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:26,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:26,109 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:26,109 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:26,109 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:26,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:26,121 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:26,121 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:26,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:26,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:26,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:26,126 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 02:55:26,126 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:26,127 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-08 02:55:26,127 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-08 02:55:26,127 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:26,127 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:26,134 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:26,134 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:26,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:26,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:26,134 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:26,134 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:26,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:26,135 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:26,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:26,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:26,135 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:26,136 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-08 02:55:26,136 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:26,136 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-08 02:55:26,136 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:26,136 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-08 02:55:26,136 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:26,136 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:26,136 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:26,137 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. started... 2023-02-08 02:55:26,137 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8e8a02a5b11b2ef4532598feeecb1f4b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:26,564 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090775f7cd8992c844e397126277e8c65f8b to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015090775f7cd8992c844e397126277e8c65f8b 2023-02-08 02:55:26,976 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp/family1/ab264ef08a5142348f47ee26c3b7313c 2023-02-08 02:55:26,989 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp/family1/ab264ef08a5142348f47ee26c3b7313c as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/ab264ef08a5142348f47ee26c3b7313c 2023-02-08 02:55:26,998 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/ab264ef08a5142348f47ee26c3b7313c, entries=1, sequenceid=37, filesize=5.0 K 2023-02-08 02:55:27,000 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e8a02a5b11b2ef4532598feeecb1f4b in 863ms, sequenceid=37, compaction requested=true 2023-02-08 02:55:27,000 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8e8a02a5b11b2ef4532598feeecb1f4b: 2023-02-08 02:55:27,000 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:27,000 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:27,001 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:27,001 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:27,001 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-08 02:55:27,001 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-08 02:55:27,049 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:27,050 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:27,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:27,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:27,051 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:27,051 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:27,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:27,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:27,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:27,054 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-08 02:55:27,054 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a2bdf14[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:27,054 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-08 02:55:27,055 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,060 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,060 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-08 02:55:27,061 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-08 02:55:27,061 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:27,061 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:27,061 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:27,070 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-08 02:55:27,070 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:27,070 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:27,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:27,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:27,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:27,071 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-08 02:55:27,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:27,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:27,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:27,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:27,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:27,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:27,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-08 02:55:27,074 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-08 02:55:27,074 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:27,074 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:27,074 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,074 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:27,081 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,081 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,081 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:27,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:27,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:27,082 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:27,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:27,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:27,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:27,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:27,082 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:27,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:27,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:27,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:27,091 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:27,091 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:27,092 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:27,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:27,092 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,092 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:27,092 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,092 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,092 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 02:55:27,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:27,092 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:27,092 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:27,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-08 02:55:27,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:27,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:27,093 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:27,093 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:27,193 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:27,194 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:27,194 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:27,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:27,207 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:27,207 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:27,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:27,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:27,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,210 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 02:55:27,210 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:27,211 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-08 02:55:27,211 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-08 02:55:27,211 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,211 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,218 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:27,218 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:27,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:27,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:27,218 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:27,218 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:27,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:27,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,220 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,220 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-08 02:55:27,220 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:27,221 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-08 02:55:27,221 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:27,222 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-08 02:55:27,223 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:27,223 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:27,223 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:27,223 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. started... 2023-02-08 02:55:27,223 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8e8a02a5b11b2ef4532598feeecb1f4b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:27,649 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511206e471e7178224d759dddc67cefba78fe to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511206e471e7178224d759dddc67cefba78fe 2023-02-08 02:55:28,056 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp/family1/785192390e904e559ef3d472f2d35470 2023-02-08 02:55:28,065 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp/family1/785192390e904e559ef3d472f2d35470 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/785192390e904e559ef3d472f2d35470 2023-02-08 02:55:28,072 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/785192390e904e559ef3d472f2d35470, entries=1, sequenceid=41, filesize=5.0 K 2023-02-08 02:55:28,073 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8e8a02a5b11b2ef4532598feeecb1f4b in 850ms, sequenceid=41, compaction requested=true 2023-02-08 02:55:28,073 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8e8a02a5b11b2ef4532598feeecb1f4b: 2023-02-08 02:55:28,074 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:28,074 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:28,074 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:28,074 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:28,074 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-08 02:55:28,074 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-08 02:55:28,123 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:28,123 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:28,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:28,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:28,124 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,125 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:28,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:28,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:28,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:28,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:28,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-08 02:55:28,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7de9fe7a[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:28,131 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-08 02:55:28,131 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,177 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,177 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-08 02:55:28,178 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-08 02:55:28,178 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:28,178 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:28,178 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:28,197 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-08 02:55:28,197 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:28,197 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-08 02:55:28,197 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:28,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:28,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:28,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:28,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:28,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:28,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:28,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:28,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:28,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:28,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-08 02:55:28,207 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-08 02:55:28,207 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:28,207 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:28,207 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,207 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:28,218 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,218 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:28,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:28,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,218 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:28,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:28,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:28,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:28,220 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:28,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:28,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:28,223 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:28,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:28,239 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:28,239 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:28,239 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:28,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:28,239 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:28,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 02:55:28,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:28,239 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,239 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:28,240 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:28,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:28,240 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:28,240 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,240 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:28,241 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:28,241 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,341 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:28,342 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:28,342 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:28,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:28,353 DEBUG [Listener at localhost.localdomain/44017] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 02:55:28,356 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:60606, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 02:55:28,358 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:28,369 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-08 02:55:28,369 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-08 02:55:28,371 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:55:28,371 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675825528371 2023-02-08 02:55:28,374 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 02:55:28,378 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-08 02:55:28,378 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-08 02:55:28,378 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] zookeeper.ReadOnlyZKClient(139): Connect 0x152ca205 to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:55:28,387 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@511c3aca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:55:28,389 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 02:55:28,892 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030c02c32e6d7e4b05b5ac9867aa1b33f5 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601030c02c32e6d7e4b05b5ac9867aa1b33f5 2023-02-08 02:55:28,894 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-08 02:55:28,912 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 02:55:28,913 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:58964, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 02:55:28,924 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:28,924 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:28,925 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 02:55:28,927 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:60618, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 02:55:28,961 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/72fd58f96edf4e199b731f884e767536 first=Optional[r3] last=Optional[r6] 2023-02-08 02:55:28,975 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/72fd58f96edf4e199b731f884e767536}] 2023-02-08 02:55:28,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/72fd58f96edf4e199b731f884e767536 for inclusion in 8e8a02a5b11b2ef4532598feeecb1f4b/family1 2023-02-08 02:55:29,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-08 02:55:29,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 02:55:29,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for 8e8a02a5b11b2ef4532598feeecb1f4b: 2023-02-08 02:55:29,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/72fd58f96edf4e199b731f884e767536 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__15js7844ck48a8q9s41aq9cr3e4mm11rmkovaodakvrf7ij0om371s0dapgcg7rt/family1/72fd58f96edf4e199b731f884e767536 2023-02-08 02:55:29,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__15js7844ck48a8q9s41aq9cr3e4mm11rmkovaodakvrf7ij0om371s0dapgcg7rt/family1/72fd58f96edf4e199b731f884e767536 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/5cec81aa1a914edfb2119b9ab7796914_SeqId_44_ 2023-02-08 02:55:29,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__15js7844ck48a8q9s41aq9cr3e4mm11rmkovaodakvrf7ij0om371s0dapgcg7rt/family1/72fd58f96edf4e199b731f884e767536 into 8e8a02a5b11b2ef4532598feeecb1f4b/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/5cec81aa1a914edfb2119b9ab7796914_SeqId_44_ - updating store file list. 2023-02-08 02:55:29,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/5cec81aa1a914edfb2119b9ab7796914_SeqId_44_ into 8e8a02a5b11b2ef4532598feeecb1f4b/family1 2023-02-08 02:55:29,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__15js7844ck48a8q9s41aq9cr3e4mm11rmkovaodakvrf7ij0om371s0dapgcg7rt/family1/72fd58f96edf4e199b731f884e767536 into 8e8a02a5b11b2ef4532598feeecb1f4b/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/5cec81aa1a914edfb2119b9ab7796914_SeqId_44_) 2023-02-08 02:55:29,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__15js7844ck48a8q9s41aq9cr3e4mm11rmkovaodakvrf7ij0om371s0dapgcg7rt/family1/72fd58f96edf4e199b731f884e767536 2023-02-08 02:55:29,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-08 02:55:29,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-08 02:55:29,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(1912): 8e8a02a5b11b2ef4532598feeecb1f4b/family1 is initiating minor compaction 2023-02-08 02:55:29,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6805a149; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:55:29,027 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 8e8a02a5b11b2ef4532598feeecb1f4b/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:29,028 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/efcce8031cfe4b1cb0e363f7b97466e3, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/5d3826e062db40c391d40f8ab282fe82, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/f165b09aff7a4e9ba847e8fb9d37e22d, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/78bf202287ce464b97c742fe1bd9f05e, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/59817d7994c74605b88b63199aab6524, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/904bbf46a7b049038ffa40ec7a83364e, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/3804b15b18b24b3c98e89b793e324285, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/ab264ef08a5142348f47ee26c3b7313c, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/785192390e904e559ef3d472f2d35470, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/5cec81aa1a914edfb2119b9ab7796914_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp, totalSize=50.2 K 2023-02-08 02:55:29,029 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting efcce8031cfe4b1cb0e363f7b97466e3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-08 02:55:29,029 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 5d3826e062db40c391d40f8ab282fe82, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-08 02:55:29,029 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting f165b09aff7a4e9ba847e8fb9d37e22d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-08 02:55:29,029 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 78bf202287ce464b97c742fe1bd9f05e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-08 02:55:29,029 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 59817d7994c74605b88b63199aab6524, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-08 02:55:29,029 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 904bbf46a7b049038ffa40ec7a83364e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-08 02:55:29,029 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 3804b15b18b24b3c98e89b793e324285, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-08 02:55:29,029 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting ab264ef08a5142348f47ee26c3b7313c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-08 02:55:29,029 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 785192390e904e559ef3d472f2d35470, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-08 02:55:29,030 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 5cec81aa1a914edfb2119b9ab7796914_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-08 02:55:29,045 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-08 02:55:29,047 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:55:29,052 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228f814528fdb144a79a88a887c1ce4bf46 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228f814528fdb144a79a88a887c1ce4bf46 2023-02-08 02:55:29,054 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015123107738912fd7548708a343e0783145865 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015123107738912fd7548708a343e0783145865 2023-02-08 02:55:29,056 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601016723b24369014b579600df152e43f2de to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601016723b24369014b579600df152e43f2de 2023-02-08 02:55:29,057 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103c1b10d8c91454455b003c8bfa6a72f91 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103c1b10d8c91454455b003c8bfa6a72f91 2023-02-08 02:55:29,058 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-02-08 02:55:29,058 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-08 02:55:29,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 02:55:29,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 02:55:29,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 02:55:29,059 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 02:55:29,059 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 02:55:29,059 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 02:55:29,059 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 02:55:29,059 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 02:55:29,088 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8e8a02a5b11b2ef4532598feeecb1f4b#family1#compaction#10 average throughput is 0.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:55:29,922 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp/family1/dbfe27ef289d4c30881336ea426734b2 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/dbfe27ef289d4c30881336ea426734b2 2023-02-08 02:55:29,938 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 8e8a02a5b11b2ef4532598feeecb1f4b/family1 of 8e8a02a5b11b2ef4532598feeecb1f4b into dbfe27ef289d4c30881336ea426734b2(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 02:55:29,938 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 8e8a02a5b11b2ef4532598feeecb1f4b: 2023-02-08 02:55:29,940 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1675824929024; duration=0sec 2023-02-08 02:55:29,941 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:55:29,960 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ab442df103664a4db0d32b3326c7a1d8 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205ab442df103664a4db0d32b3326c7a1d8 2023-02-08 02:55:29,962 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-08 02:55:29,980 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:29,980 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:29,991 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e81746bd4b534a72b62d7df815f70d83 first=Optional[r00] last=Optional[r2] 2023-02-08 02:55:29,992 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e81746bd4b534a72b62d7df815f70d83}] 2023-02-08 02:55:29,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e81746bd4b534a72b62d7df815f70d83 for inclusion in 8e8a02a5b11b2ef4532598feeecb1f4b/family1 2023-02-08 02:55:29,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-08 02:55:29,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 02:55:29,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for 8e8a02a5b11b2ef4532598feeecb1f4b: 2023-02-08 02:55:30,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e81746bd4b534a72b62d7df815f70d83 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__8qf0so3o0133k8lm0d0ic6e20grhtmdmchdmaqp5matrb0okj4ng6n5rp814mg0k/family1/e81746bd4b534a72b62d7df815f70d83 2023-02-08 02:55:30,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__8qf0so3o0133k8lm0d0ic6e20grhtmdmchdmaqp5matrb0okj4ng6n5rp814mg0k/family1/e81746bd4b534a72b62d7df815f70d83 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/75784cfe4796488bb8740b47ac1304fd_SeqId_47_ 2023-02-08 02:55:30,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__8qf0so3o0133k8lm0d0ic6e20grhtmdmchdmaqp5matrb0okj4ng6n5rp814mg0k/family1/e81746bd4b534a72b62d7df815f70d83 into 8e8a02a5b11b2ef4532598feeecb1f4b/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/75784cfe4796488bb8740b47ac1304fd_SeqId_47_ - updating store file list. 2023-02-08 02:55:30,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/75784cfe4796488bb8740b47ac1304fd_SeqId_47_ into 8e8a02a5b11b2ef4532598feeecb1f4b/family1 2023-02-08 02:55:30,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__8qf0so3o0133k8lm0d0ic6e20grhtmdmchdmaqp5matrb0okj4ng6n5rp814mg0k/family1/e81746bd4b534a72b62d7df815f70d83 into 8e8a02a5b11b2ef4532598feeecb1f4b/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/75784cfe4796488bb8740b47ac1304fd_SeqId_47_) 2023-02-08 02:55:30,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__8qf0so3o0133k8lm0d0ic6e20grhtmdmchdmaqp5matrb0okj4ng6n5rp814mg0k/family1/e81746bd4b534a72b62d7df815f70d83 2023-02-08 02:55:30,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-08 02:55:30,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-08 02:55:30,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(1912): 8e8a02a5b11b2ef4532598feeecb1f4b/family1 is initiating minor compaction (all files) 2023-02-08 02:55:30,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6639f2c5; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:55:30,013 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 8e8a02a5b11b2ef4532598feeecb1f4b/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:30,014 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/d91687e6128847c5a0e7a851806cd8ef, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/dbfe27ef289d4c30881336ea426734b2, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/75784cfe4796488bb8740b47ac1304fd_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp, totalSize=358.6 K 2023-02-08 02:55:30,018 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting d91687e6128847c5a0e7a851806cd8ef, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878815769 2023-02-08 02:55:30,020 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting dbfe27ef289d4c30881336ea426734b2, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621215769 2023-02-08 02:55:30,021 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-08 02:55:30,023 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 75784cfe4796488bb8740b47ac1304fd_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878815769 2023-02-08 02:55:30,023 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/efcce8031cfe4b1cb0e363f7b97466e3, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/5d3826e062db40c391d40f8ab282fe82, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/f165b09aff7a4e9ba847e8fb9d37e22d, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/78bf202287ce464b97c742fe1bd9f05e, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/59817d7994c74605b88b63199aab6524, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/904bbf46a7b049038ffa40ec7a83364e, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/3804b15b18b24b3c98e89b793e324285, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/ab264ef08a5142348f47ee26c3b7313c, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/785192390e904e559ef3d472f2d35470, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/5cec81aa1a914edfb2119b9ab7796914_SeqId_44_] to archive 2023-02-08 02:55:30,024 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:55:30,024 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:55:30,026 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511301ffbf9e73e3149b39c5d01311961b6b9 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511301ffbf9e73e3149b39c5d01311961b6b9 2023-02-08 02:55:30,026 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/efcce8031cfe4b1cb0e363f7b97466e3 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/efcce8031cfe4b1cb0e363f7b97466e3 2023-02-08 02:55:30,027 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201c32d62c0636a412fb735230ac549dacf to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201c32d62c0636a412fb735230ac549dacf 2023-02-08 02:55:30,028 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/5d3826e062db40c391d40f8ab282fe82 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/5d3826e062db40c391d40f8ab282fe82 2023-02-08 02:55:30,029 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205e95fb3bb56d247938ba6716143cf9163 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205e95fb3bb56d247938ba6716143cf9163 2023-02-08 02:55:30,029 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-02-08 02:55:30,029 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-08 02:55:30,030 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 02:55:30,030 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-08 02:55:30,030 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:55:30,031 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-08 02:55:30,032 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/f165b09aff7a4e9ba847e8fb9d37e22d to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/f165b09aff7a4e9ba847e8fb9d37e22d 2023-02-08 02:55:30,034 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.6690 sec 2023-02-08 02:55:30,034 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/78bf202287ce464b97c742fe1bd9f05e to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/78bf202287ce464b97c742fe1bd9f05e 2023-02-08 02:55:30,035 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/59817d7994c74605b88b63199aab6524 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/59817d7994c74605b88b63199aab6524 2023-02-08 02:55:30,037 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/904bbf46a7b049038ffa40ec7a83364e to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/904bbf46a7b049038ffa40ec7a83364e 2023-02-08 02:55:30,038 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/3804b15b18b24b3c98e89b793e324285 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/3804b15b18b24b3c98e89b793e324285 2023-02-08 02:55:30,039 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/ab264ef08a5142348f47ee26c3b7313c to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/ab264ef08a5142348f47ee26c3b7313c 2023-02-08 02:55:30,041 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/785192390e904e559ef3d472f2d35470 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/785192390e904e559ef3d472f2d35470 2023-02-08 02:55:30,043 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/5cec81aa1a914edfb2119b9ab7796914_SeqId_44_ to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/5cec81aa1a914edfb2119b9ab7796914_SeqId_44_ 2023-02-08 02:55:30,073 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8e8a02a5b11b2ef4532598feeecb1f4b#family1#compaction#11 average throughput is 4.72 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:55:30,180 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:30,181 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:30,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.HMaster$12(2441): Client=jenkins//136.243.104.168 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-08 02:55:30,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:30,612 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-08 02:55:30,615 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-08 02:55:30,615 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-08 02:55:30,623 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-02-08 02:55:30,637 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=8e8a02a5b11b2ef4532598feeecb1f4b, REOPEN/MOVE}] 2023-02-08 02:55:30,638 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=8e8a02a5b11b2ef4532598feeecb1f4b, REOPEN/MOVE 2023-02-08 02:55:30,639 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=8e8a02a5b11b2ef4532598feeecb1f4b, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:30,640 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675824930639"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675824930639"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675824930639"}]},"ts":"1675824930639"} 2023-02-08 02:55:30,642 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 8e8a02a5b11b2ef4532598feeecb1f4b, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:55:30,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close 8e8a02a5b11b2ef4532598feeecb1f4b 2023-02-08 02:55:30,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 8e8a02a5b11b2ef4532598feeecb1f4b, disabling compactions & flushes 2023-02-08 02:55:30,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:31,319 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/.tmp/family1/85ec9c9e74e44bd5a1907bbdcb87e284 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/85ec9c9e74e44bd5a1907bbdcb87e284 2023-02-08 02:55:31,327 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 8e8a02a5b11b2ef4532598feeecb1f4b/family1 of 8e8a02a5b11b2ef4532598feeecb1f4b into 85ec9c9e74e44bd5a1907bbdcb87e284(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:55:31,327 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 8e8a02a5b11b2ef4532598feeecb1f4b: 2023-02-08 02:55:31,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:31,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:31,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. after waiting 0 ms 2023-02-08 02:55:31,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:31,327 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1675824930012; duration=1sec 2023-02-08 02:55:31,327 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:55:31,330 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/d91687e6128847c5a0e7a851806cd8ef, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/dbfe27ef289d4c30881336ea426734b2, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/75784cfe4796488bb8740b47ac1304fd_SeqId_47_] to archive 2023-02-08 02:55:31,332 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:55:31,334 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/d91687e6128847c5a0e7a851806cd8ef to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/d91687e6128847c5a0e7a851806cd8ef 2023-02-08 02:55:31,335 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/dbfe27ef289d4c30881336ea426734b2 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/dbfe27ef289d4c30881336ea426734b2 2023-02-08 02:55:31,337 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/75784cfe4796488bb8740b47ac1304fd_SeqId_47_ to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/75784cfe4796488bb8740b47ac1304fd_SeqId_47_ 2023-02-08 02:55:31,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-08 02:55:31,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:31,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 8e8a02a5b11b2ef4532598feeecb1f4b: Waiting for close lock at 1675824930807Running coprocessor pre-close hooks at 1675824930807Disabling compacts and flushes for region at 1675824930807Disabling writes for close at 1675824931327 (+520 ms)Writing region close event to WAL at 1675824931339 (+12 ms)Running coprocessor post-close hooks at 1675824931344 (+5 ms)Closed at 1675824931345 (+1 ms) 2023-02-08 02:55:31,345 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 8e8a02a5b11b2ef4532598feeecb1f4b to self. 2023-02-08 02:55:31,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed 8e8a02a5b11b2ef4532598feeecb1f4b 2023-02-08 02:55:31,348 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=8e8a02a5b11b2ef4532598feeecb1f4b, regionState=CLOSED 2023-02-08 02:55:31,348 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675824931348"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675824931348"}]},"ts":"1675824931348"} 2023-02-08 02:55:31,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-08 02:55:31,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 8e8a02a5b11b2ef4532598feeecb1f4b, server=jenkins-hbase12.apache.org,44577,1675824910652 in 708 msec 2023-02-08 02:55:31,353 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=8e8a02a5b11b2ef4532598feeecb1f4b, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=true 2023-02-08 02:55:31,504 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=8e8a02a5b11b2ef4532598feeecb1f4b, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:31,505 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675824931504"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675824931504"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675824931504"}]},"ts":"1675824931504"} 2023-02-08 02:55:31,511 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 8e8a02a5b11b2ef4532598feeecb1f4b, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:55:31,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:31,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8e8a02a5b11b2ef4532598feeecb1f4b, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b.', STARTKEY => '', ENDKEY => ''} 2023-02-08 02:55:31,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 8e8a02a5b11b2ef4532598feeecb1f4b 2023-02-08 02:55:31,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:55:31,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 8e8a02a5b11b2ef4532598feeecb1f4b 2023-02-08 02:55:31,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 8e8a02a5b11b2ef4532598feeecb1f4b 2023-02-08 02:55:31,670 INFO [StoreOpener-8e8a02a5b11b2ef4532598feeecb1f4b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8e8a02a5b11b2ef4532598feeecb1f4b 2023-02-08 02:55:31,671 DEBUG [StoreOpener-8e8a02a5b11b2ef4532598feeecb1f4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1 2023-02-08 02:55:31,672 DEBUG [StoreOpener-8e8a02a5b11b2ef4532598feeecb1f4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1 2023-02-08 02:55:31,672 INFO [StoreOpener-8e8a02a5b11b2ef4532598feeecb1f4b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e8a02a5b11b2ef4532598feeecb1f4b columnFamilyName family1 2023-02-08 02:55:31,682 DEBUG [StoreOpener-8e8a02a5b11b2ef4532598feeecb1f4b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/85ec9c9e74e44bd5a1907bbdcb87e284 2023-02-08 02:55:31,682 INFO [StoreOpener-8e8a02a5b11b2ef4532598feeecb1f4b-1] regionserver.HStore(310): Store=8e8a02a5b11b2ef4532598feeecb1f4b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:55:31,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b 2023-02-08 02:55:31,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b 2023-02-08 02:55:31,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 8e8a02a5b11b2ef4532598feeecb1f4b 2023-02-08 02:55:31,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 8e8a02a5b11b2ef4532598feeecb1f4b; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69184065, jitterRate=0.03092290461063385}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 02:55:31,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 8e8a02a5b11b2ef4532598feeecb1f4b: Running coprocessor pre-open hook at 1675824931668Writing region info on filesystem at 1675824931668Initializing all the Stores at 1675824931669 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675824931670 (+1 ms)Cleaning up temporary data from old regions at 1675824931686 (+16 ms)Cleaning up detritus from prior splits at 1675824931687 (+1 ms)Running coprocessor post-open hooks at 1675824931690 (+3 ms)Region opened successfully at 1675824931690 2023-02-08 02:55:31,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b., pid=17, masterSystemTime=1675824931664 2023-02-08 02:55:31,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:31,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:55:31,693 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=8e8a02a5b11b2ef4532598feeecb1f4b, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:31,693 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675824931693"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675824931693"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675824931693"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675824931693"}]},"ts":"1675824931693"} 2023-02-08 02:55:31,697 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-02-08 02:55:31,697 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 8e8a02a5b11b2ef4532598feeecb1f4b, server=jenkins-hbase12.apache.org,44577,1675824910652 in 184 msec 2023-02-08 02:55:31,700 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-02-08 02:55:31,700 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=8e8a02a5b11b2ef4532598feeecb1f4b, REOPEN/MOVE in 1.0600 sec 2023-02-08 02:55:31,706 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-02-08 02:55:31,706 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0800 sec 2023-02-08 02:55:31,709 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.5200 sec 2023-02-08 02:55:31,711 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:31,711 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:31,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-02-08 02:55:31,713 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:31,713 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:31,719 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:31,719 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:31,720 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(278): alter status finished 2023-02-08 02:55:31,721 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 02:55:31,723 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-08 02:55:31,724 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-08 02:55:31,726 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:55:31,726 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675825531725 2023-02-08 02:55:31,727 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 02:55:31,728 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-08 02:55:31,728 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-08 02:55:31,729 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] zookeeper.ReadOnlyZKClient(139): Connect 0x09dc4494 to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:55:31,745 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@402d6c3f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:55:31,745 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 02:55:31,745 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 02:55:31,745 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 02:55:31,746 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 02:55:31,746 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 02:55:32,181 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112814f1a567cb9140a196a5bc4ec60a125c to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112814f1a567cb9140a196a5bc4ec60a125c 2023-02-08 02:55:32,182 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-08 02:55:32,194 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 02:55:32,195 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:58966, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 02:55:32,203 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:32,203 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:32,204 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 02:55:32,206 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:60630, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 02:55:32,219 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4a71c70dd08a42eb8d392a79eb216d2e first=Optional[r05] last=Optional[r8] 2023-02-08 02:55:32,219 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4a71c70dd08a42eb8d392a79eb216d2e}] 2023-02-08 02:55:32,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4a71c70dd08a42eb8d392a79eb216d2e for inclusion in 8e8a02a5b11b2ef4532598feeecb1f4b/family1 2023-02-08 02:55:32,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-08 02:55:32,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 02:55:32,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for 8e8a02a5b11b2ef4532598feeecb1f4b: 2023-02-08 02:55:32,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4a71c70dd08a42eb8d392a79eb216d2e to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__njtcb3cfc5jl0vhumqjsdn0m9ap3vmpd3qq71ct5mn2umc47ntuf4t52nsrcckrs/family1/4a71c70dd08a42eb8d392a79eb216d2e 2023-02-08 02:55:32,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__njtcb3cfc5jl0vhumqjsdn0m9ap3vmpd3qq71ct5mn2umc47ntuf4t52nsrcckrs/family1/4a71c70dd08a42eb8d392a79eb216d2e as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/30df6fbef25e4ff98592128075cba796_SeqId_53_ 2023-02-08 02:55:32,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__njtcb3cfc5jl0vhumqjsdn0m9ap3vmpd3qq71ct5mn2umc47ntuf4t52nsrcckrs/family1/4a71c70dd08a42eb8d392a79eb216d2e into 8e8a02a5b11b2ef4532598feeecb1f4b/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/30df6fbef25e4ff98592128075cba796_SeqId_53_ - updating store file list. 2023-02-08 02:55:32,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/30df6fbef25e4ff98592128075cba796_SeqId_53_ into 8e8a02a5b11b2ef4532598feeecb1f4b/family1 2023-02-08 02:55:32,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__njtcb3cfc5jl0vhumqjsdn0m9ap3vmpd3qq71ct5mn2umc47ntuf4t52nsrcckrs/family1/4a71c70dd08a42eb8d392a79eb216d2e into 8e8a02a5b11b2ef4532598feeecb1f4b/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/family1/30df6fbef25e4ff98592128075cba796_SeqId_53_) 2023-02-08 02:55:32,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__njtcb3cfc5jl0vhumqjsdn0m9ap3vmpd3qq71ct5mn2umc47ntuf4t52nsrcckrs/family1/4a71c70dd08a42eb8d392a79eb216d2e 2023-02-08 02:55:32,245 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-08 02:55:32,246 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:55:32,248 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511206e471e7178224d759dddc67cefba78fe to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511206e471e7178224d759dddc67cefba78fe 2023-02-08 02:55:32,249 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511284d3b0454bf934f05998b327d4a179bc9 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511284d3b0454bf934f05998b327d4a179bc9 2023-02-08 02:55:32,249 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-02-08 02:55:32,249 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-08 02:55:32,250 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 02:55:32,250 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 02:55:32,250 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 02:55:32,250 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-08 02:55:32,250 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:55:32,251 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-08 02:55:32,253 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 529 msec 2023-02-08 02:55:32,336 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=243 (was 210) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:58530 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49602@0x152ca205 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1815409583.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:58468 [Waiting for operation #20] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1337922479_15 at /127.0.0.1:58594 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:58578 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:58702 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4e1da959-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7bc52e5f-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49602@0x152ca205-SendThread(127.0.0.1:49602) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:58624 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49602@0x152ca205-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x4e1da959-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4e1da959-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:58714 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:58646 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49602@0x09dc4494 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1815409583.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:58502 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase12:44577-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:58488 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:58650 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7bc52e5f-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:58546 [Waiting for operation #30] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49602@0x09dc4494-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:58604 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49602@0x09dc4494-SendThread(127.0.0.1:49602) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=584 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=213 (was 234), ProcessCount=171 (was 171), AvailableMemoryMB=3614 (was 3733) 2023-02-08 02:55:32,349 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=243, OpenFileDescriptor=584, MaxFileDescriptor=60000, SystemLoadAverage=213, ProcessCount=171, AvailableMemoryMB=3613 2023-02-08 02:55:32,349 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:32,349 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:32,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-08 02:55:32,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:32,355 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 02:55:32,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-02-08 02:55:32,355 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:32,355 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:32,356 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 02:55:32,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-08 02:55:32,357 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6 2023-02-08 02:55:32,358 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6 empty. 2023-02-08 02:55:32,358 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6 2023-02-08 02:55:32,358 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-02-08 02:55:32,456 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:32,457 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:32,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-08 02:55:32,658 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:32,658 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:32,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-08 02:55:32,767 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-08 02:55:32,768 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => f6afe823b53fe9004da5adcb7d0357b6, NAME => 'testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp 2023-02-08 02:55:32,959 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:32,959 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:32,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-08 02:55:33,186 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:55:33,187 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing f6afe823b53fe9004da5adcb7d0357b6, disabling compactions & flushes 2023-02-08 02:55:33,187 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:33,187 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:33,187 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. after waiting 0 ms 2023-02-08 02:55:33,187 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:33,187 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:33,187 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for f6afe823b53fe9004da5adcb7d0357b6: Waiting for close lock at 1675824933187Disabling compacts and flushes for region at 1675824933187Disabling writes for close at 1675824933187Writing region close event to WAL at 1675824933187Closed at 1675824933187 2023-02-08 02:55:33,191 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 02:55:33,192 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675824933192"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675824933192"}]},"ts":"1675824933192"} 2023-02-08 02:55:33,194 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 02:55:33,195 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 02:55:33,195 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675824933195"}]},"ts":"1675824933195"} 2023-02-08 02:55:33,197 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-08 02:55:33,218 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=f6afe823b53fe9004da5adcb7d0357b6, ASSIGN}] 2023-02-08 02:55:33,220 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=f6afe823b53fe9004da5adcb7d0357b6, ASSIGN 2023-02-08 02:55:33,221 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=f6afe823b53fe9004da5adcb7d0357b6, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=false 2023-02-08 02:55:33,373 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=f6afe823b53fe9004da5adcb7d0357b6, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:33,373 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675824933373"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675824933373"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675824933373"}]},"ts":"1675824933373"} 2023-02-08 02:55:33,376 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure f6afe823b53fe9004da5adcb7d0357b6, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:55:33,461 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:33,461 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:33,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-08 02:55:33,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:33,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f6afe823b53fe9004da5adcb7d0357b6, NAME => 'testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6.', STARTKEY => '', ENDKEY => ''} 2023-02-08 02:55:33,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy f6afe823b53fe9004da5adcb7d0357b6 2023-02-08 02:55:33,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:55:33,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for f6afe823b53fe9004da5adcb7d0357b6 2023-02-08 02:55:33,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for f6afe823b53fe9004da5adcb7d0357b6 2023-02-08 02:55:33,539 INFO [StoreOpener-f6afe823b53fe9004da5adcb7d0357b6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f6afe823b53fe9004da5adcb7d0357b6 2023-02-08 02:55:33,542 DEBUG [StoreOpener-f6afe823b53fe9004da5adcb7d0357b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1 2023-02-08 02:55:33,542 DEBUG [StoreOpener-f6afe823b53fe9004da5adcb7d0357b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1 2023-02-08 02:55:33,542 INFO [StoreOpener-f6afe823b53fe9004da5adcb7d0357b6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6afe823b53fe9004da5adcb7d0357b6 columnFamilyName family1 2023-02-08 02:55:33,545 INFO [StoreOpener-f6afe823b53fe9004da5adcb7d0357b6-1] regionserver.HStore(310): Store=f6afe823b53fe9004da5adcb7d0357b6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:55:33,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6 2023-02-08 02:55:33,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6 2023-02-08 02:55:33,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for f6afe823b53fe9004da5adcb7d0357b6 2023-02-08 02:55:33,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:55:33,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened f6afe823b53fe9004da5adcb7d0357b6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68906959, jitterRate=0.0267937034368515}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 02:55:33,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for f6afe823b53fe9004da5adcb7d0357b6: Running coprocessor pre-open hook at 1675824933537Writing region info on filesystem at 1675824933537Initializing all the Stores at 1675824933538 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675824933539 (+1 ms)Cleaning up temporary data from old regions at 1675824933547 (+8 ms)Cleaning up detritus from prior splits at 1675824933547Running coprocessor post-open hooks at 1675824933553 (+6 ms)Region opened successfully at 1675824933553 2023-02-08 02:55:33,554 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6., pid=21, masterSystemTime=1675824933529 2023-02-08 02:55:33,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:33,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:33,556 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=f6afe823b53fe9004da5adcb7d0357b6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:33,556 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675824933556"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675824933556"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675824933556"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675824933556"}]},"ts":"1675824933556"} 2023-02-08 02:55:33,560 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-08 02:55:33,560 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure f6afe823b53fe9004da5adcb7d0357b6, server=jenkins-hbase12.apache.org,44577,1675824910652 in 182 msec 2023-02-08 02:55:33,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-02-08 02:55:33,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=f6afe823b53fe9004da5adcb7d0357b6, ASSIGN in 343 msec 2023-02-08 02:55:33,562 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 02:55:33,562 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675824933562"}]},"ts":"1675824933562"} 2023-02-08 02:55:33,564 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-08 02:55:33,576 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 02:55:33,578 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.2250 sec 2023-02-08 02:55:34,464 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:34,464 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:34,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-08 02:55:34,466 INFO [Listener at localhost.localdomain/44017] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-02-08 02:55:34,504 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:34,504 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:34,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:34,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:34,507 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 02:55:34,507 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:34,507 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 02:55:34,507 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 02:55:34,508 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:34,508 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:34,520 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:34,520 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:34,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:34,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:34,521 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:34,521 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:34,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:34,521 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:34,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:34,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:34,522 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:34,522 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:34,522 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 02:55:34,522 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:34,523 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 02:55:34,523 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:34,523 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:34,523 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:34,523 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. started... 2023-02-08 02:55:34,524 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f6afe823b53fe9004da5adcb7d0357b6 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-08 02:55:34,949 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511308904e92920e5468c8854f32699ae9bcb to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511308904e92920e5468c8854f32699ae9bcb 2023-02-08 02:55:35,355 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/b13b4b2c5c8f4c82995552c309189a9d 2023-02-08 02:55:35,365 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/b13b4b2c5c8f4c82995552c309189a9d as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/b13b4b2c5c8f4c82995552c309189a9d 2023-02-08 02:55:35,373 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/b13b4b2c5c8f4c82995552c309189a9d, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-08 02:55:35,374 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for f6afe823b53fe9004da5adcb7d0357b6 in 851ms, sequenceid=5, compaction requested=false 2023-02-08 02:55:35,374 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 02:55:35,375 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f6afe823b53fe9004da5adcb7d0357b6: 2023-02-08 02:55:35,375 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:35,375 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:35,375 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:35,375 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:35,375 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 02:55:35,375 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-08 02:55:35,386 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:35,386 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:35,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:35,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:35,386 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,386 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:35,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:35,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:35,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:35,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:35,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 02:55:35,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@790f5022[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:35,388 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 02:55:35,388 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,449 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,450 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 02:55:35,450 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-08 02:55:35,450 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:35,450 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:35,450 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:35,563 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:35,563 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 02:55:35,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:35,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:35,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:35,563 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:35,564 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-08 02:55:35,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:35,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:35,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:35,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:35,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:35,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:35,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:55:35,576 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-08 02:55:35,576 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:35,576 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:35,576 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,576 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:35,586 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,586 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:35,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:35,586 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:35,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:35,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:35,587 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:35,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:35,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:35,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:35,590 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:35,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:35,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:35,607 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:35,607 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:35,607 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:35,607 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,607 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:35,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 02:55:35,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:35,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:35,607 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:35,608 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:35,608 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,608 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,608 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:35,608 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,608 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:35,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:35,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:35,708 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:35,709 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:35,709 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:35,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:35,721 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:35,722 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:35,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:35,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:35,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,725 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 02:55:35,725 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:35,726 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 02:55:35,726 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 02:55:35,727 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,727 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,733 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:35,733 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:35,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:35,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:35,733 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:35,733 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:35,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,734 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:35,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,734 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,734 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 02:55:35,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:35,735 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 02:55:35,735 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:35,735 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 02:55:35,735 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:35,735 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:35,735 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:35,735 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. started... 2023-02-08 02:55:35,735 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f6afe823b53fe9004da5adcb7d0357b6 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-08 02:55:35,751 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511289c69a9ee1e9d4c56ab8b1dd7934fb2b3 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511289c69a9ee1e9d4c56ab8b1dd7934fb2b3 2023-02-08 02:55:36,160 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/194bc94e5f8d45b78085c2c4be2b6197 2023-02-08 02:55:36,170 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/194bc94e5f8d45b78085c2c4be2b6197 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/194bc94e5f8d45b78085c2c4be2b6197 2023-02-08 02:55:36,175 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/194bc94e5f8d45b78085c2c4be2b6197, entries=1, sequenceid=9, filesize=5.0 K 2023-02-08 02:55:36,176 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for f6afe823b53fe9004da5adcb7d0357b6 in 441ms, sequenceid=9, compaction requested=false 2023-02-08 02:55:36,177 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f6afe823b53fe9004da5adcb7d0357b6: 2023-02-08 02:55:36,177 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:36,177 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:36,177 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:36,177 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:36,177 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 02:55:36,177 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-08 02:55:36,185 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:36,185 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:36,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:36,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:36,186 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:36,186 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:36,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:36,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:36,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:36,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 02:55:36,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c52ba88[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:36,188 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 02:55:36,188 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,196 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,196 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 02:55:36,196 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:36,196 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:36,196 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-08 02:55:36,196 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:36,207 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 02:55:36,207 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:36,207 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:36,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:36,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:36,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:36,207 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-08 02:55:36,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:36,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:36,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:36,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:36,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:36,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:36,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:55:36,210 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-08 02:55:36,210 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:36,210 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:36,210 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,210 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:36,217 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,217 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:36,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:36,217 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:36,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:36,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:36,218 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:36,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:36,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:36,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:36,219 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:36,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:36,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:36,253 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:36,253 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:36,253 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 02:55:36,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:36,254 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:36,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:36,253 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:36,253 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:36,254 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:36,255 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:36,254 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:36,256 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:36,256 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,256 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:36,355 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:36,356 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:36,356 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:36,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:36,361 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:36,362 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:36,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:36,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:36,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,365 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 02:55:36,365 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:36,365 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 02:55:36,365 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 02:55:36,366 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,366 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,407 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:36,407 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:36,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:36,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:36,407 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:36,407 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:36,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,408 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:36,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,408 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,408 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 02:55:36,408 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:36,408 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 02:55:36,408 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:36,409 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 02:55:36,409 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:36,409 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:36,409 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:36,409 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. started... 2023-02-08 02:55:36,409 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f6afe823b53fe9004da5adcb7d0357b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:36,831 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512016fcd6822a631464ebf7727ffe3fc9618 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512016fcd6822a631464ebf7727ffe3fc9618 2023-02-08 02:55:36,880 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 02:55:37,239 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/71d53c2cd31c4a8cb6ad203523b165c4 2023-02-08 02:55:37,250 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/71d53c2cd31c4a8cb6ad203523b165c4 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/71d53c2cd31c4a8cb6ad203523b165c4 2023-02-08 02:55:37,257 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/71d53c2cd31c4a8cb6ad203523b165c4, entries=1, sequenceid=13, filesize=4.9 K 2023-02-08 02:55:37,258 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f6afe823b53fe9004da5adcb7d0357b6 in 849ms, sequenceid=13, compaction requested=true 2023-02-08 02:55:37,258 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f6afe823b53fe9004da5adcb7d0357b6: 2023-02-08 02:55:37,258 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:37,258 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:37,258 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:37,258 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,258 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 02:55:37,258 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-08 02:55:37,301 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,301 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:37,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:37,302 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,302 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:37,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:37,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:37,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:37,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 02:55:37,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78850969[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:37,305 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 02:55:37,305 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,312 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,312 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 02:55:37,312 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-08 02:55:37,312 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:37,312 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,312 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:37,322 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 02:55:37,322 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,322 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:37,323 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-08 02:55:37,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:37,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:37,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:37,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:37,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:37,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:37,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:55:37,330 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-08 02:55:37,330 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:37,330 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:37,330 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,330 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:37,343 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,343 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:37,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:37,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,343 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:37,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:37,344 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:37,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:37,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:37,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,345 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:37,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,354 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,354 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:37,354 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:37,354 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:37,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 02:55:37,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:37,354 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 02:55:37,354 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:37,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:37,354 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,355 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:37,355 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,355 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:37,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:37,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:37,355 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,355 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,355 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,455 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:37,456 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:37,456 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:37,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:37,464 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:37,464 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:37,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:37,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:37,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,468 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 02:55:37,468 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:37,469 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 02:55:37,469 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 02:55:37,470 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,470 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,480 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,480 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:37,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:37,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:37,481 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,481 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:37,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,482 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:37,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,483 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,484 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 02:55:37,484 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,484 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 02:55:37,484 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:37,485 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 02:55:37,485 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:37,485 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:37,485 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:37,486 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. started... 2023-02-08 02:55:37,486 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f6afe823b53fe9004da5adcb7d0357b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:37,912 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a61f1aeb00fd4f898784e573f6fdfb8f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205a61f1aeb00fd4f898784e573f6fdfb8f 2023-02-08 02:55:37,919 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/47c22e7ecdb9427596eb05152c81bf17 2023-02-08 02:55:37,926 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/47c22e7ecdb9427596eb05152c81bf17 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/47c22e7ecdb9427596eb05152c81bf17 2023-02-08 02:55:37,933 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/47c22e7ecdb9427596eb05152c81bf17, entries=1, sequenceid=17, filesize=4.9 K 2023-02-08 02:55:37,934 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f6afe823b53fe9004da5adcb7d0357b6 in 448ms, sequenceid=17, compaction requested=true 2023-02-08 02:55:37,934 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f6afe823b53fe9004da5adcb7d0357b6: 2023-02-08 02:55:37,934 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:37,934 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:37,934 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:37,934 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,934 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 02:55:37,934 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-08 02:55:37,975 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,975 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:37,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:37,975 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,975 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:37,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:37,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:37,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:37,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 02:55:37,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4aad222d[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:37,977 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 02:55:37,977 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,985 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,986 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 02:55:37,986 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-08 02:55:37,986 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:37,986 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,986 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:37,996 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 02:55:37,996 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,996 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:37,996 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-08 02:55:37,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:37,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:37,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:37,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:37,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:37,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:37,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:37,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:55:37,999 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-08 02:55:37,999 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:37,999 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:37,999 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:37,999 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:38,006 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:38,006 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:38,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:38,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:38,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:38,006 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:38,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:38,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:38,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:38,007 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:38,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:38,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:38,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:38,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:38,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:38,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:38,008 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:38,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:38,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:38,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:38,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:38,017 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:38,017 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:38,017 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:38,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:38,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:38,017 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:38,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 02:55:38,017 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 02:55:38,017 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:38,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:38,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:38,017 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:38,017 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:38,018 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:38,018 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:38,018 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:38,018 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:38,018 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:38,018 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:38,118 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:38,119 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:38,119 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:38,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:38,130 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:38,130 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:38,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:38,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:38,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:38,135 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 02:55:38,135 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:38,136 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 02:55:38,136 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 02:55:38,136 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:38,136 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:38,143 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:38,143 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:38,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:38,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:38,144 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:38,144 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:38,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:38,144 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:38,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:38,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:38,144 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:38,144 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 02:55:38,145 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:38,145 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 02:55:38,145 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:38,145 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 02:55:38,146 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:38,146 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:38,147 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:38,147 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. started... 2023-02-08 02:55:38,147 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f6afe823b53fe9004da5adcb7d0357b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:38,563 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228a2cd2c7e3a2b411e84f15a2a53993a54 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228a2cd2c7e3a2b411e84f15a2a53993a54 2023-02-08 02:55:38,970 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/f9ef90318eb44a40bc33b68de773a2f8 2023-02-08 02:55:38,976 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/f9ef90318eb44a40bc33b68de773a2f8 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/f9ef90318eb44a40bc33b68de773a2f8 2023-02-08 02:55:38,983 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/f9ef90318eb44a40bc33b68de773a2f8, entries=1, sequenceid=21, filesize=4.9 K 2023-02-08 02:55:38,984 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f6afe823b53fe9004da5adcb7d0357b6 in 837ms, sequenceid=21, compaction requested=true 2023-02-08 02:55:38,984 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f6afe823b53fe9004da5adcb7d0357b6: 2023-02-08 02:55:38,984 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:38,984 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:38,984 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:38,984 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:38,984 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 02:55:38,984 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-08 02:55:39,038 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,038 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:39,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:39,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:39,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:39,039 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,039 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:39,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:39,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:39,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:39,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:39,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 02:55:39,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49a0f51a[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:39,042 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 02:55:39,042 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,049 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,049 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:39,049 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:39,049 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 02:55:39,049 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-08 02:55:39,049 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:39,059 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 02:55:39,059 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:39,059 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-08 02:55:39,059 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:39,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:39,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:39,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:39,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:39,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:39,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:39,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:39,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:39,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:39,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:55:39,064 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-08 02:55:39,064 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:39,064 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:39,064 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,064 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:39,099 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,099 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:39,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,099 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:39,100 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:39,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,102 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:39,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:39,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:39,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:39,122 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:39,122 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:39,123 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:39,123 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 02:55:39,123 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:39,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:39,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 02:55:39,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:39,123 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:39,123 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,125 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:39,125 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:39,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:39,125 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:39,125 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:39,125 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,125 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,226 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:39,226 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:39,226 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:39,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:39,238 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:39,239 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:39,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:39,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:39,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,243 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 02:55:39,243 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:39,244 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 02:55:39,244 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 02:55:39,245 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,245 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,257 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:39,257 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:39,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:39,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:39,257 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:39,258 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:39,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:39,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,258 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,259 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 02:55:39,259 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:39,259 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 02:55:39,259 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:39,259 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 02:55:39,259 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:39,260 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:39,260 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:39,260 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. started... 2023-02-08 02:55:39,260 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f6afe823b53fe9004da5adcb7d0357b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:39,686 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c772110b15774085a19904e0ee415bb9 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231c772110b15774085a19904e0ee415bb9 2023-02-08 02:55:40,094 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/31707fa4d8434f6ea5ad6ecbf101a649 2023-02-08 02:55:40,101 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/31707fa4d8434f6ea5ad6ecbf101a649 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/31707fa4d8434f6ea5ad6ecbf101a649 2023-02-08 02:55:40,106 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/31707fa4d8434f6ea5ad6ecbf101a649, entries=1, sequenceid=25, filesize=4.9 K 2023-02-08 02:55:40,107 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f6afe823b53fe9004da5adcb7d0357b6 in 847ms, sequenceid=25, compaction requested=true 2023-02-08 02:55:40,107 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f6afe823b53fe9004da5adcb7d0357b6: 2023-02-08 02:55:40,107 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:40,107 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:40,107 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:40,107 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:40,107 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 02:55:40,108 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-08 02:55:40,259 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,259 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:40,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:40,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:40,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:40,262 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,262 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:40,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:40,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:40,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:40,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:40,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 02:55:40,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@204f805c[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:40,268 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 02:55:40,268 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,280 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,281 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 02:55:40,281 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-08 02:55:40,281 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:40,281 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:40,281 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:40,291 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:40,291 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 02:55:40,291 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:40,291 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-08 02:55:40,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:40,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:40,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:40,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:40,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:40,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:40,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:40,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:40,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:40,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:55:40,301 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-08 02:55:40,301 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:40,302 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:40,302 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,302 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:40,312 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,312 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,312 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:40,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:40,313 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:40,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:40,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:40,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,315 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:40,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:40,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:40,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:40,322 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:40,322 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,322 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:40,322 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,322 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:40,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:40,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:40,322 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 02:55:40,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 02:55:40,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:40,322 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:40,322 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:40,323 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:40,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:40,323 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,323 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,323 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:40,323 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:40,423 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:40,424 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:40,424 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:40,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:40,434 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:40,435 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:40,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:40,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:40,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,439 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 02:55:40,439 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:40,439 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 02:55:40,439 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 02:55:40,440 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,440 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,448 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:40,448 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:40,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:40,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:40,449 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:40,449 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:40,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,450 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:40,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,450 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,450 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 02:55:40,450 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:40,450 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 02:55:40,451 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:40,451 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 02:55:40,451 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:40,451 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:40,451 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:40,451 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. started... 2023-02-08 02:55:40,451 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f6afe823b53fe9004da5adcb7d0357b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:40,868 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101612ead6c89aa4a43b0d0b76b596e11db to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101612ead6c89aa4a43b0d0b76b596e11db 2023-02-08 02:55:41,275 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/6e99110cc03a4795bb219157caa5713a 2023-02-08 02:55:41,281 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/6e99110cc03a4795bb219157caa5713a as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/6e99110cc03a4795bb219157caa5713a 2023-02-08 02:55:41,287 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/6e99110cc03a4795bb219157caa5713a, entries=1, sequenceid=29, filesize=4.9 K 2023-02-08 02:55:41,288 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f6afe823b53fe9004da5adcb7d0357b6 in 837ms, sequenceid=29, compaction requested=true 2023-02-08 02:55:41,288 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f6afe823b53fe9004da5adcb7d0357b6: 2023-02-08 02:55:41,288 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:41,288 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:41,288 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:41,288 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:41,288 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 02:55:41,288 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-08 02:55:41,402 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:41,402 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:41,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:41,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:41,403 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,403 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:41,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:41,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:41,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:41,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:41,404 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 02:55:41,404 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70510b7d[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:41,404 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 02:55:41,405 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,531 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,532 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 02:55:41,532 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-08 02:55:41,532 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:41,532 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:41,532 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:41,685 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 02:55:41,685 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:41,685 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-08 02:55:41,685 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:41,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:41,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:41,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:41,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:41,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:41,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:41,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:41,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:41,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:41,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:55:41,689 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-08 02:55:41,689 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:41,689 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:41,689 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,689 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:41,822 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,822 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:41,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:41,822 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:41,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:41,824 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:41,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:41,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:41,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:41,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,827 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:41,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:41,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:41,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:41,869 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:41,869 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,870 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,870 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:41,870 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:41,869 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:41,870 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 02:55:41,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:41,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:41,870 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 02:55:41,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:41,870 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,870 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:41,871 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:41,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:41,871 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:41,871 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:41,971 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:41,971 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:41,971 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:41,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:41,981 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:41,981 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:41,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:41,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:41,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,986 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 02:55:41,986 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:41,987 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 02:55:41,987 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 02:55:41,988 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,988 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,996 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:41,996 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:41,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:41,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:41,996 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:41,996 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:41,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:41,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,997 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,997 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 02:55:41,997 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:41,999 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 02:55:41,999 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:41,999 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 02:55:41,999 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:41,999 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:41,999 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:42,000 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. started... 2023-02-08 02:55:42,000 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f6afe823b53fe9004da5adcb7d0357b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:42,423 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103de722779646a466fb50a39d497aa507d to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103de722779646a466fb50a39d497aa507d 2023-02-08 02:55:42,431 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/a6653f7c97fe471a8b96af9c7e2a4e8a 2023-02-08 02:55:42,439 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/a6653f7c97fe471a8b96af9c7e2a4e8a as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/a6653f7c97fe471a8b96af9c7e2a4e8a 2023-02-08 02:55:42,446 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/a6653f7c97fe471a8b96af9c7e2a4e8a, entries=1, sequenceid=33, filesize=4.9 K 2023-02-08 02:55:42,447 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f6afe823b53fe9004da5adcb7d0357b6 in 447ms, sequenceid=33, compaction requested=true 2023-02-08 02:55:42,447 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f6afe823b53fe9004da5adcb7d0357b6: 2023-02-08 02:55:42,447 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:42,447 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:42,447 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:42,447 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:42,447 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 02:55:42,447 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-08 02:55:42,501 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:42,501 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:42,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:42,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:42,502 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,502 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:42,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:42,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:42,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:42,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:42,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 02:55:42,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@534ee310[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:42,504 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 02:55:42,504 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,544 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,545 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 02:55:42,545 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-08 02:55:42,545 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:42,545 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:42,546 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:42,564 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 02:55:42,564 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:42,564 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:42,564 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-08 02:55:42,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:42,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:42,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:42,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:42,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:42,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:42,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:42,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:42,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:42,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:55:42,567 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-08 02:55:42,567 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:42,567 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:42,567 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,567 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:42,585 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,585 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,585 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:42,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:42,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:42,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:42,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:42,586 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:42,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:42,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:42,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,588 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:42,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:42,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:42,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,606 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:42,606 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:42,606 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:42,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 02:55:42,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:42,606 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:42,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:42,606 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:42,606 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,607 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:42,608 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:42,608 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:42,608 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,608 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,608 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,608 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 02:55:42,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:42,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:42,708 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:42,708 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:42,708 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:42,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:42,715 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:42,716 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:42,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:42,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:42,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,719 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 02:55:42,719 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:42,720 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 02:55:42,720 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 02:55:42,721 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,721 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,732 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:42,732 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:42,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:42,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:42,734 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:42,734 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:42,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:42,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,736 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,736 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 02:55:42,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:42,736 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 02:55:42,736 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:42,737 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 02:55:42,738 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:42,738 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:42,738 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:42,738 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. started... 2023-02-08 02:55:42,738 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f6afe823b53fe9004da5adcb7d0357b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:43,161 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907c46e6716d1484c12af2bab197a83c233 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907c46e6716d1484c12af2bab197a83c233 2023-02-08 02:55:43,569 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/6e7a73d8e954476c939cef3cc2bb062e 2023-02-08 02:55:43,580 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/6e7a73d8e954476c939cef3cc2bb062e as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/6e7a73d8e954476c939cef3cc2bb062e 2023-02-08 02:55:43,588 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/6e7a73d8e954476c939cef3cc2bb062e, entries=1, sequenceid=37, filesize=4.9 K 2023-02-08 02:55:43,589 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f6afe823b53fe9004da5adcb7d0357b6 in 851ms, sequenceid=37, compaction requested=true 2023-02-08 02:55:43,590 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f6afe823b53fe9004da5adcb7d0357b6: 2023-02-08 02:55:43,590 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:43,590 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:43,590 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:43,590 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:43,590 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 02:55:43,590 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-08 02:55:43,617 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:43,617 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:43,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:43,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:43,618 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,618 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:43,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:43,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:43,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:43,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 02:55:43,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d08c446[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:43,621 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 02:55:43,622 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,627 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,628 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 02:55:43,628 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-08 02:55:43,628 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:43,628 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:43,628 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:43,638 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:43,638 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 02:55:43,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:43,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:43,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:43,638 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:43,638 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-08 02:55:43,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:43,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:43,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:43,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:43,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:43,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:43,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:55:43,641 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-08 02:55:43,641 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:43,641 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:43,641 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,641 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:43,648 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,648 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,648 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:43,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:43,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:43,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:43,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:43,649 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:43,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:43,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:43,650 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:43,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:43,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:43,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,659 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:43,659 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:43,659 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,659 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:43,659 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,660 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:43,660 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,660 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,659 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:43,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 02:55:43,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 02:55:43,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:43,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:43,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:43,660 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:43,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:43,661 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:43,661 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:43,761 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:43,761 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:43,761 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:43,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:43,766 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:43,766 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:43,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:43,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:43,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,769 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 02:55:43,769 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:43,769 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 02:55:43,769 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 02:55:43,770 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,770 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,785 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:43,785 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:43,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:43,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:43,785 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:43,785 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:43,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:43,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,786 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,787 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 02:55:43,787 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:43,787 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 02:55:43,787 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:43,788 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 02:55:43,788 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:43,788 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:43,788 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:43,788 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. started... 2023-02-08 02:55:43,788 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f6afe823b53fe9004da5adcb7d0357b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:44,207 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511200d721fda3cc4430c8f7ff7e776556365 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511200d721fda3cc4430c8f7ff7e776556365 2023-02-08 02:55:44,614 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/7b48b3890ddd4f648cf936453203efbe 2023-02-08 02:55:44,622 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/7b48b3890ddd4f648cf936453203efbe as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/7b48b3890ddd4f648cf936453203efbe 2023-02-08 02:55:44,628 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/7b48b3890ddd4f648cf936453203efbe, entries=1, sequenceid=41, filesize=4.9 K 2023-02-08 02:55:44,629 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f6afe823b53fe9004da5adcb7d0357b6 in 841ms, sequenceid=41, compaction requested=true 2023-02-08 02:55:44,629 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f6afe823b53fe9004da5adcb7d0357b6: 2023-02-08 02:55:44,629 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:44,629 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:44,629 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:44,630 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:44,630 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 02:55:44,630 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-08 02:55:44,637 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:44,638 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:44,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:44,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:44,638 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,638 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:44,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:44,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:44,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:44,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:44,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 02:55:44,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4119eadb[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:44,640 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 02:55:44,641 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,648 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,648 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 02:55:44,648 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:44,649 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:44,648 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-08 02:55:44,649 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:44,659 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:44,659 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 02:55:44,659 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:44,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:44,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:44,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:44,659 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-08 02:55:44,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:44,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:44,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:44,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:44,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:44,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:44,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:55:44,668 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-08 02:55:44,668 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:44,668 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:44,668 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,668 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:44,680 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,680 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:44,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,680 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:44,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:44,681 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:44,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:44,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:44,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:44,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:44,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,684 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:44,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:44,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:44,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:44,699 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:44,699 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:44,699 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:44,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 02:55:44,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:44,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:44,699 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 02:55:44,699 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:44,699 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,699 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:44,701 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:44,699 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:44,701 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:44,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:44,701 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,701 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:44,701 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,801 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:44,801 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:44,802 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:44,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:44,804 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-02-08 02:55:44,807 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 02:55:44,808 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 02:55:44,809 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:55:44,809 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675825544809 2023-02-08 02:55:44,811 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 02:55:44,812 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-08 02:55:44,813 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 02:55:44,813 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] zookeeper.ReadOnlyZKClient(139): Connect 0x37042479 to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:55:44,828 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c63ea32, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:55:44,828 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 02:55:45,266 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030b355f0442404b9daf42c5e38aa729e4 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601030b355f0442404b9daf42c5e38aa729e4 2023-02-08 02:55:45,268 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 02:55:45,282 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 02:55:45,283 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:43232, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 02:55:45,289 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:45,290 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:45,290 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 02:55:45,291 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:40400, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 02:55:45,302 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/fcde23547f51475b8531f1d222e88c3a first=Optional[r5] last=Optional[r6] 2023-02-08 02:55:45,303 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/fcde23547f51475b8531f1d222e88c3a}] 2023-02-08 02:55:45,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/fcde23547f51475b8531f1d222e88c3a for inclusion in f6afe823b53fe9004da5adcb7d0357b6/family1 2023-02-08 02:55:45,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-08 02:55:45,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 02:55:45,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for f6afe823b53fe9004da5adcb7d0357b6: 2023-02-08 02:55:45,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/fcde23547f51475b8531f1d222e88c3a to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithMonthlyPolicy__9vb8unh7ur6qja62vs20p7219d1rj64ui018pgauc69cuhsom6ppfreehkj6360r/family1/fcde23547f51475b8531f1d222e88c3a 2023-02-08 02:55:45,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithMonthlyPolicy__9vb8unh7ur6qja62vs20p7219d1rj64ui018pgauc69cuhsom6ppfreehkj6360r/family1/fcde23547f51475b8531f1d222e88c3a as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/97773cf70fe34c1c9a9aa1fc49eee560_SeqId_44_ 2023-02-08 02:55:45,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithMonthlyPolicy__9vb8unh7ur6qja62vs20p7219d1rj64ui018pgauc69cuhsom6ppfreehkj6360r/family1/fcde23547f51475b8531f1d222e88c3a into f6afe823b53fe9004da5adcb7d0357b6/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/97773cf70fe34c1c9a9aa1fc49eee560_SeqId_44_ - updating store file list. 2023-02-08 02:55:45,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/97773cf70fe34c1c9a9aa1fc49eee560_SeqId_44_ into f6afe823b53fe9004da5adcb7d0357b6/family1 2023-02-08 02:55:45,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithMonthlyPolicy__9vb8unh7ur6qja62vs20p7219d1rj64ui018pgauc69cuhsom6ppfreehkj6360r/family1/fcde23547f51475b8531f1d222e88c3a into f6afe823b53fe9004da5adcb7d0357b6/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/97773cf70fe34c1c9a9aa1fc49eee560_SeqId_44_) 2023-02-08 02:55:45,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithMonthlyPolicy__9vb8unh7ur6qja62vs20p7219d1rj64ui018pgauc69cuhsom6ppfreehkj6360r/family1/fcde23547f51475b8531f1d222e88c3a 2023-02-08 02:55:45,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-08 02:55:45,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-08 02:55:45,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(1912): f6afe823b53fe9004da5adcb7d0357b6/family1 is initiating minor compaction 2023-02-08 02:55:45,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1fca1fdf; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:55:45,327 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of f6afe823b53fe9004da5adcb7d0357b6/family1 in testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:45,327 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/194bc94e5f8d45b78085c2c4be2b6197, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/71d53c2cd31c4a8cb6ad203523b165c4, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/47c22e7ecdb9427596eb05152c81bf17, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/f9ef90318eb44a40bc33b68de773a2f8, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/31707fa4d8434f6ea5ad6ecbf101a649, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/6e99110cc03a4795bb219157caa5713a, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/a6653f7c97fe471a8b96af9c7e2a4e8a, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/6e7a73d8e954476c939cef3cc2bb062e, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/7b48b3890ddd4f648cf936453203efbe, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/97773cf70fe34c1c9a9aa1fc49eee560_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp, totalSize=49.7 K 2023-02-08 02:55:45,327 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 194bc94e5f8d45b78085c2c4be2b6197, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-08 02:55:45,327 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 71d53c2cd31c4a8cb6ad203523b165c4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-08 02:55:45,327 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 47c22e7ecdb9427596eb05152c81bf17, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-08 02:55:45,327 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting f9ef90318eb44a40bc33b68de773a2f8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-08 02:55:45,327 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 31707fa4d8434f6ea5ad6ecbf101a649, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-08 02:55:45,327 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 6e99110cc03a4795bb219157caa5713a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-08 02:55:45,327 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting a6653f7c97fe471a8b96af9c7e2a4e8a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-08 02:55:45,328 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 6e7a73d8e954476c939cef3cc2bb062e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-08 02:55:45,328 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 7b48b3890ddd4f648cf936453203efbe, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-08 02:55:45,328 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 97773cf70fe34c1c9a9aa1fc49eee560_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-08 02:55:45,329 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 02:55:45,330 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:55:45,332 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101612ead6c89aa4a43b0d0b76b596e11db to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101612ead6c89aa4a43b0d0b76b596e11db 2023-02-08 02:55:45,333 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103de722779646a466fb50a39d497aa507d to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103de722779646a466fb50a39d497aa507d 2023-02-08 02:55:45,333 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-08 02:55:45,333 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-08 02:55:45,334 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 02:55:45,334 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 02:55:45,384 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] throttle.PressureAwareThroughputController(145): f6afe823b53fe9004da5adcb7d0357b6#family1#compaction#22 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:55:45,810 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/f219d5b29688429aab275a907bdbf975 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/f219d5b29688429aab275a907bdbf975 2023-02-08 02:55:45,817 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in f6afe823b53fe9004da5adcb7d0357b6/family1 of f6afe823b53fe9004da5adcb7d0357b6 into f219d5b29688429aab275a907bdbf975(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 02:55:45,817 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for f6afe823b53fe9004da5adcb7d0357b6: 2023-02-08 02:55:45,817 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1675824945327; duration=0sec 2023-02-08 02:55:45,817 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:55:45,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/194bc94e5f8d45b78085c2c4be2b6197, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/71d53c2cd31c4a8cb6ad203523b165c4, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/47c22e7ecdb9427596eb05152c81bf17, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/f9ef90318eb44a40bc33b68de773a2f8, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/31707fa4d8434f6ea5ad6ecbf101a649, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/6e99110cc03a4795bb219157caa5713a, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/a6653f7c97fe471a8b96af9c7e2a4e8a, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/6e7a73d8e954476c939cef3cc2bb062e, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/7b48b3890ddd4f648cf936453203efbe, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/97773cf70fe34c1c9a9aa1fc49eee560_SeqId_44_] to archive 2023-02-08 02:55:45,925 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:55:45,927 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/194bc94e5f8d45b78085c2c4be2b6197 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/194bc94e5f8d45b78085c2c4be2b6197 2023-02-08 02:55:45,929 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/71d53c2cd31c4a8cb6ad203523b165c4 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/71d53c2cd31c4a8cb6ad203523b165c4 2023-02-08 02:55:45,930 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/47c22e7ecdb9427596eb05152c81bf17 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/47c22e7ecdb9427596eb05152c81bf17 2023-02-08 02:55:45,932 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/f9ef90318eb44a40bc33b68de773a2f8 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/f9ef90318eb44a40bc33b68de773a2f8 2023-02-08 02:55:45,933 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/31707fa4d8434f6ea5ad6ecbf101a649 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/31707fa4d8434f6ea5ad6ecbf101a649 2023-02-08 02:55:45,934 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/6e99110cc03a4795bb219157caa5713a to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/6e99110cc03a4795bb219157caa5713a 2023-02-08 02:55:45,936 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/a6653f7c97fe471a8b96af9c7e2a4e8a to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/a6653f7c97fe471a8b96af9c7e2a4e8a 2023-02-08 02:55:45,937 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/6e7a73d8e954476c939cef3cc2bb062e to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/6e7a73d8e954476c939cef3cc2bb062e 2023-02-08 02:55:45,939 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/7b48b3890ddd4f648cf936453203efbe to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/7b48b3890ddd4f648cf936453203efbe 2023-02-08 02:55:45,940 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/97773cf70fe34c1c9a9aa1fc49eee560_SeqId_44_ to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/97773cf70fe34c1c9a9aa1fc49eee560_SeqId_44_ 2023-02-08 02:55:46,217 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231cf23cc99043e42d6b5570f36b0853d50 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231cf23cc99043e42d6b5570f36b0853d50 2023-02-08 02:55:46,219 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 02:55:46,234 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:46,235 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:46,244 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/689dc61b76cb445180e1cb24c68a4446 first=Optional[r1] last=Optional[r4] 2023-02-08 02:55:46,245 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/689dc61b76cb445180e1cb24c68a4446}] 2023-02-08 02:55:46,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/689dc61b76cb445180e1cb24c68a4446 for inclusion in f6afe823b53fe9004da5adcb7d0357b6/family1 2023-02-08 02:55:46,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-08 02:55:46,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 02:55:46,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for f6afe823b53fe9004da5adcb7d0357b6: 2023-02-08 02:55:46,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/689dc61b76cb445180e1cb24c68a4446 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithMonthlyPolicy__k0ttc9d28rqbt92bckphmvbpi9b95js521a6he2vbb75cqja36i7tvbifhhil6pq/family1/689dc61b76cb445180e1cb24c68a4446 2023-02-08 02:55:46,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithMonthlyPolicy__k0ttc9d28rqbt92bckphmvbpi9b95js521a6he2vbb75cqja36i7tvbifhhil6pq/family1/689dc61b76cb445180e1cb24c68a4446 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/ad1ce8e93e8646eeaeddfbe1776afd8f_SeqId_47_ 2023-02-08 02:55:46,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithMonthlyPolicy__k0ttc9d28rqbt92bckphmvbpi9b95js521a6he2vbb75cqja36i7tvbifhhil6pq/family1/689dc61b76cb445180e1cb24c68a4446 into f6afe823b53fe9004da5adcb7d0357b6/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/ad1ce8e93e8646eeaeddfbe1776afd8f_SeqId_47_ - updating store file list. 2023-02-08 02:55:46,261 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/ad1ce8e93e8646eeaeddfbe1776afd8f_SeqId_47_ into f6afe823b53fe9004da5adcb7d0357b6/family1 2023-02-08 02:55:46,261 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithMonthlyPolicy__k0ttc9d28rqbt92bckphmvbpi9b95js521a6he2vbb75cqja36i7tvbifhhil6pq/family1/689dc61b76cb445180e1cb24c68a4446 into f6afe823b53fe9004da5adcb7d0357b6/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/ad1ce8e93e8646eeaeddfbe1776afd8f_SeqId_47_) 2023-02-08 02:55:46,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithMonthlyPolicy__k0ttc9d28rqbt92bckphmvbpi9b95js521a6he2vbb75cqja36i7tvbifhhil6pq/family1/689dc61b76cb445180e1cb24c68a4446 2023-02-08 02:55:46,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-08 02:55:46,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-08 02:55:46,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(1912): f6afe823b53fe9004da5adcb7d0357b6/family1 is initiating minor compaction (all files) 2023-02-08 02:55:46,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@450dd399; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:55:46,263 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of f6afe823b53fe9004da5adcb7d0357b6/family1 in testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:55:46,263 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/b13b4b2c5c8f4c82995552c309189a9d, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/f219d5b29688429aab275a907bdbf975, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/ad1ce8e93e8646eeaeddfbe1776afd8f_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp, totalSize=178.1 K 2023-02-08 02:55:46,263 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting b13b4b2c5c8f4c82995552c309189a9d, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878815769 2023-02-08 02:55:46,264 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting f219d5b29688429aab275a907bdbf975, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621215769 2023-02-08 02:55:46,264 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting ad1ce8e93e8646eeaeddfbe1776afd8f_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965215769 2023-02-08 02:55:46,265 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 02:55:46,265 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:55:46,267 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512016fcd6822a631464ebf7727ffe3fc9618 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512016fcd6822a631464ebf7727ffe3fc9618 2023-02-08 02:55:46,269 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205a61f1aeb00fd4f898784e573f6fdfb8f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205a61f1aeb00fd4f898784e573f6fdfb8f 2023-02-08 02:55:46,271 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228a2cd2c7e3a2b411e84f15a2a53993a54 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228a2cd2c7e3a2b411e84f15a2a53993a54 2023-02-08 02:55:46,272 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231c772110b15774085a19904e0ee415bb9 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231c772110b15774085a19904e0ee415bb9 2023-02-08 02:55:46,273 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-08 02:55:46,273 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-08 02:55:46,273 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 02:55:46,273 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 02:55:46,290 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] throttle.PressureAwareThroughputController(145): f6afe823b53fe9004da5adcb7d0357b6#family1#compaction#23 average throughput is 9.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:55:46,739 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113013c9d354255943ea89567f40f1f21fda to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113013c9d354255943ea89567f40f1f21fda 2023-02-08 02:55:46,740 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 02:55:46,760 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:46,760 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:46,769 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/240e6e42e0cf4d2c962c3a2d068f9258 first=Optional[r00] last=Optional[r8] 2023-02-08 02:55:46,770 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/240e6e42e0cf4d2c962c3a2d068f9258}] 2023-02-08 02:55:46,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/240e6e42e0cf4d2c962c3a2d068f9258 for inclusion in f6afe823b53fe9004da5adcb7d0357b6/family1 2023-02-08 02:55:46,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-08 02:55:46,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 02:55:46,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for f6afe823b53fe9004da5adcb7d0357b6: 2023-02-08 02:55:46,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/240e6e42e0cf4d2c962c3a2d068f9258 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ujnvc04dgf6njepql1v8ra1kfvj5ltiti7n82jv78d64ib1mm23n47ento8l9d05/family1/240e6e42e0cf4d2c962c3a2d068f9258 2023-02-08 02:55:46,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ujnvc04dgf6njepql1v8ra1kfvj5ltiti7n82jv78d64ib1mm23n47ento8l9d05/family1/240e6e42e0cf4d2c962c3a2d068f9258 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/71a19ee9d9754943bc028973cd33fc9c_SeqId_49_ 2023-02-08 02:55:46,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ujnvc04dgf6njepql1v8ra1kfvj5ltiti7n82jv78d64ib1mm23n47ento8l9d05/family1/240e6e42e0cf4d2c962c3a2d068f9258 into f6afe823b53fe9004da5adcb7d0357b6/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/71a19ee9d9754943bc028973cd33fc9c_SeqId_49_ - updating store file list. 2023-02-08 02:55:46,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/71a19ee9d9754943bc028973cd33fc9c_SeqId_49_ into f6afe823b53fe9004da5adcb7d0357b6/family1 2023-02-08 02:55:46,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ujnvc04dgf6njepql1v8ra1kfvj5ltiti7n82jv78d64ib1mm23n47ento8l9d05/family1/240e6e42e0cf4d2c962c3a2d068f9258 into f6afe823b53fe9004da5adcb7d0357b6/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/71a19ee9d9754943bc028973cd33fc9c_SeqId_49_) 2023-02-08 02:55:46,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ujnvc04dgf6njepql1v8ra1kfvj5ltiti7n82jv78d64ib1mm23n47ento8l9d05/family1/240e6e42e0cf4d2c962c3a2d068f9258 2023-02-08 02:55:46,791 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 02:55:46,792 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:55:46,794 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511200d721fda3cc4430c8f7ff7e776556365 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511200d721fda3cc4430c8f7ff7e776556365 2023-02-08 02:55:46,795 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511289c69a9ee1e9d4c56ab8b1dd7934fb2b3 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511289c69a9ee1e9d4c56ab8b1dd7934fb2b3 2023-02-08 02:55:46,797 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511308904e92920e5468c8854f32699ae9bcb to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511308904e92920e5468c8854f32699ae9bcb 2023-02-08 02:55:46,797 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-08 02:55:46,797 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-08 02:55:46,806 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 02:55:46,806 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 02:55:46,806 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 02:55:46,806 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 02:55:46,806 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:55:46,807 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 02:55:46,810 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.0020 sec 2023-02-08 02:55:46,943 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=257 (was 243) Potentially hanging thread: hconnection-0x3f17cf86-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:38458 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-308626503-136.243.104.168-1675824905611:blk_1073741898_1074, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:45148 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49602@0x37042479 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1815409583.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d724dba5dbb74dc19ff79cb9df3e0ed3 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/8a13adb3c88846f89ed22b16d2600220 block BP-308626503-136.243.104.168-1675824905611:blk_1073741898_1074 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: hconnection-0x3f17cf86-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49602@0x37042479-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49602@0x37042479-SendThread(127.0.0.1:49602) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:44982 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/cluster_1ef4d685-639e-f899-0aba-3988a080901f/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:45082 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f17cf86-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:45044 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:45036 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:44996 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f17cf86-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:45060 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1337922479_15 at /127.0.0.1:45140 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:38408 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:38472 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:44986 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1337922479_15 at /127.0.0.1:45164 [Receiving block BP-308626503-136.243.104.168-1675824905611:blk_1073741898_1074] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f17cf86-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:45068 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ResponseProcessor for block BP-308626503-136.243.104.168-1675824905611:blk_1073741898_1074 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1080) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:44966 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:38432 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:38386 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f17cf86-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1776886777_15 at /127.0.0.1:38460 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/cluster_1ef4d685-639e-f899-0aba-3988a080901f/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f17cf86-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=617 (was 584) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=235 (was 213) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 171) - ProcessCount LEAK? -, AvailableMemoryMB=3512 (was 3613) 2023-02-08 02:55:46,954 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=257, OpenFileDescriptor=617, MaxFileDescriptor=60000, SystemLoadAverage=235, ProcessCount=172, AvailableMemoryMB=3511 2023-02-08 02:55:46,955 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:46,955 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:46,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-08 02:55:46,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:46,960 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 02:55:46,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-02-08 02:55:46,960 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:46,961 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:46,961 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 02:55:46,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-08 02:55:46,962 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577 2023-02-08 02:55:46,963 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577 empty. 2023-02-08 02:55:46,963 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577 2023-02-08 02:55:46,964 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-02-08 02:55:46,979 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-08 02:55:46,981 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 88d8f58a018f7a402bf36777b8b04577, NAME => 'testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp 2023-02-08 02:55:47,062 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:47,062 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:47,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-08 02:55:47,263 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:47,263 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:47,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-08 02:55:47,394 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:55:47,394 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing 88d8f58a018f7a402bf36777b8b04577, disabling compactions & flushes 2023-02-08 02:55:47,395 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:47,395 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:47,395 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. after waiting 0 ms 2023-02-08 02:55:47,395 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:47,395 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:47,395 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 88d8f58a018f7a402bf36777b8b04577: Waiting for close lock at 1675824947394Disabling compacts and flushes for region at 1675824947394Disabling writes for close at 1675824947395 (+1 ms)Writing region close event to WAL at 1675824947395Closed at 1675824947395 2023-02-08 02:55:47,397 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 02:55:47,398 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675824947398"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675824947398"}]},"ts":"1675824947398"} 2023-02-08 02:55:47,400 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 02:55:47,401 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 02:55:47,401 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675824947401"}]},"ts":"1675824947401"} 2023-02-08 02:55:47,403 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-08 02:55:47,498 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=88d8f58a018f7a402bf36777b8b04577, ASSIGN}] 2023-02-08 02:55:47,502 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=88d8f58a018f7a402bf36777b8b04577, ASSIGN 2023-02-08 02:55:47,505 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=88d8f58a018f7a402bf36777b8b04577, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=false 2023-02-08 02:55:47,556 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/.tmp/family1/8a13adb3c88846f89ed22b16d2600220 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/8a13adb3c88846f89ed22b16d2600220 2023-02-08 02:55:47,564 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in f6afe823b53fe9004da5adcb7d0357b6/family1 of f6afe823b53fe9004da5adcb7d0357b6 into 8a13adb3c88846f89ed22b16d2600220(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:55:47,564 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for f6afe823b53fe9004da5adcb7d0357b6: 2023-02-08 02:55:47,564 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1675824946262; duration=1sec 2023-02-08 02:55:47,565 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:47,565 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:47,565 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:55:47,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-08 02:55:47,615 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/b13b4b2c5c8f4c82995552c309189a9d, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/f219d5b29688429aab275a907bdbf975, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/ad1ce8e93e8646eeaeddfbe1776afd8f_SeqId_47_] to archive 2023-02-08 02:55:47,617 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:55:47,621 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/b13b4b2c5c8f4c82995552c309189a9d to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/b13b4b2c5c8f4c82995552c309189a9d 2023-02-08 02:55:47,625 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/f219d5b29688429aab275a907bdbf975 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/f219d5b29688429aab275a907bdbf975 2023-02-08 02:55:47,628 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/ad1ce8e93e8646eeaeddfbe1776afd8f_SeqId_47_ to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/family1/ad1ce8e93e8646eeaeddfbe1776afd8f_SeqId_47_ 2023-02-08 02:55:47,656 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=88d8f58a018f7a402bf36777b8b04577, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:47,656 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675824947656"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675824947656"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675824947656"}]},"ts":"1675824947656"} 2023-02-08 02:55:47,659 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 88d8f58a018f7a402bf36777b8b04577, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:55:47,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:47,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 88d8f58a018f7a402bf36777b8b04577, NAME => 'testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577.', STARTKEY => '', ENDKEY => ''} 2023-02-08 02:55:47,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 88d8f58a018f7a402bf36777b8b04577 2023-02-08 02:55:47,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:55:47,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 88d8f58a018f7a402bf36777b8b04577 2023-02-08 02:55:47,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 88d8f58a018f7a402bf36777b8b04577 2023-02-08 02:55:47,819 INFO [StoreOpener-88d8f58a018f7a402bf36777b8b04577-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 88d8f58a018f7a402bf36777b8b04577 2023-02-08 02:55:47,821 DEBUG [StoreOpener-88d8f58a018f7a402bf36777b8b04577-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1 2023-02-08 02:55:47,822 DEBUG [StoreOpener-88d8f58a018f7a402bf36777b8b04577-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1 2023-02-08 02:55:47,822 INFO [StoreOpener-88d8f58a018f7a402bf36777b8b04577-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 88d8f58a018f7a402bf36777b8b04577 columnFamilyName family1 2023-02-08 02:55:47,825 INFO [StoreOpener-88d8f58a018f7a402bf36777b8b04577-1] regionserver.HStore(310): Store=88d8f58a018f7a402bf36777b8b04577/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:55:47,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577 2023-02-08 02:55:47,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577 2023-02-08 02:55:47,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 88d8f58a018f7a402bf36777b8b04577 2023-02-08 02:55:47,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:55:47,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 88d8f58a018f7a402bf36777b8b04577; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63674324, jitterRate=-0.05117863416671753}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 02:55:47,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 88d8f58a018f7a402bf36777b8b04577: Running coprocessor pre-open hook at 1675824947816Writing region info on filesystem at 1675824947816Initializing all the Stores at 1675824947818 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675824947818Cleaning up temporary data from old regions at 1675824947828 (+10 ms)Cleaning up detritus from prior splits at 1675824947829 (+1 ms)Running coprocessor post-open hooks at 1675824947838 (+9 ms)Region opened successfully at 1675824947838 2023-02-08 02:55:47,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577., pid=25, masterSystemTime=1675824947812 2023-02-08 02:55:47,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:47,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:47,844 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=88d8f58a018f7a402bf36777b8b04577, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:47,844 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675824947843"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675824947843"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675824947843"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675824947843"}]},"ts":"1675824947843"} 2023-02-08 02:55:47,848 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-02-08 02:55:47,848 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 88d8f58a018f7a402bf36777b8b04577, server=jenkins-hbase12.apache.org,44577,1675824910652 in 187 msec 2023-02-08 02:55:47,849 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-02-08 02:55:47,850 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=88d8f58a018f7a402bf36777b8b04577, ASSIGN in 350 msec 2023-02-08 02:55:47,850 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 02:55:47,850 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675824947850"}]},"ts":"1675824947850"} 2023-02-08 02:55:47,851 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-08 02:55:47,860 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 02:55:47,862 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 903 msec 2023-02-08 02:55:48,066 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:48,066 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:48,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-08 02:55:48,068 INFO [Listener at localhost.localdomain/44017] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-02-08 02:55:48,116 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 02:55:48,116 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x152ca205 to 127.0.0.1:49602 2023-02-08 02:55:48,116 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:55:48,117 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 02:55:48,118 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09dc4494 to 127.0.0.1:49602 2023-02-08 02:55:48,118 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:55:48,118 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 02:55:48,119 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37042479 to 127.0.0.1:49602 2023-02-08 02:55:48,119 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:55:48,122 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:48,122 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:48,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:48,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:48,124 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 02:55:48,124 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:48,125 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 02:55:48,125 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 02:55:48,223 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:48,223 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:48,236 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:48,236 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:48,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:48,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:48,236 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:48,236 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:48,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:48,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:48,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:48,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:48,238 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:48,239 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:48,239 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 02:55:48,239 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:48,239 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 02:55:48,239 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:48,239 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:48,240 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:48,240 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. started... 2023-02-08 02:55:48,241 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 88d8f58a018f7a402bf36777b8b04577 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-08 02:55:48,673 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113045f9ab1bc8fc4b9c9ef4da9b3237c261 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015113045f9ab1bc8fc4b9c9ef4da9b3237c261 2023-02-08 02:55:49,082 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp/family1/e16cf2aa8a104bc6a9568e502fb9418f 2023-02-08 02:55:49,097 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp/family1/e16cf2aa8a104bc6a9568e502fb9418f as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/e16cf2aa8a104bc6a9568e502fb9418f 2023-02-08 02:55:49,108 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/e16cf2aa8a104bc6a9568e502fb9418f, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-08 02:55:49,109 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 88d8f58a018f7a402bf36777b8b04577 in 868ms, sequenceid=5, compaction requested=false 2023-02-08 02:55:49,109 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 02:55:49,110 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 88d8f58a018f7a402bf36777b8b04577: 2023-02-08 02:55:49,110 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:49,110 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:49,110 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:49,110 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:49,110 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 02:55:49,111 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-08 02:55:49,121 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:49,121 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:49,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:49,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:49,122 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,122 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:49,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:49,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:49,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:49,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:49,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 02:55:49,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@396b0b66[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:49,123 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 02:55:49,123 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,132 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,132 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 02:55:49,132 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:49,132 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:49,132 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-08 02:55:49,132 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:49,142 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 02:55:49,143 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:49,142 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:49,143 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-08 02:55:49,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:49,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:49,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:49,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:49,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:49,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:49,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:49,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:49,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:49,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:55:49,145 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-08 02:55:49,146 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:49,146 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:49,146 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,146 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:49,153 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,153 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,153 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:49,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:49,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:49,154 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:49,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:49,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:49,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:49,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:49,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:49,155 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:49,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:49,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:49,164 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:49,164 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:49,164 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:49,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 02:55:49,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:49,164 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,164 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:49,164 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,164 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 02:55:49,164 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:49,164 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:49,164 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,164 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:49,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:49,164 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:49,164 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:49,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:49,265 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:49,265 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:49,265 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:49,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:49,272 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:49,273 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:49,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:49,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:49,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,277 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 02:55:49,277 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:49,277 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 02:55:49,277 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 02:55:49,278 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,278 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,300 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:49,300 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:49,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:49,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:49,301 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:49,301 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:49,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:49,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,302 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,302 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 02:55:49,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:49,303 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 02:55:49,303 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:49,303 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 02:55:49,303 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:49,303 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:49,303 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:49,303 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. started... 2023-02-08 02:55:49,303 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 88d8f58a018f7a402bf36777b8b04577 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-08 02:55:49,723 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128a005a6a6909a4305b20183682962d26c to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128a005a6a6909a4305b20183682962d26c 2023-02-08 02:55:50,131 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp/family1/c113f35db94e4fe68ce8e6492d48956c 2023-02-08 02:55:50,146 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp/family1/c113f35db94e4fe68ce8e6492d48956c as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/c113f35db94e4fe68ce8e6492d48956c 2023-02-08 02:55:50,153 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/c113f35db94e4fe68ce8e6492d48956c, entries=1, sequenceid=9, filesize=5.0 K 2023-02-08 02:55:50,154 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 88d8f58a018f7a402bf36777b8b04577 in 851ms, sequenceid=9, compaction requested=false 2023-02-08 02:55:50,154 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 88d8f58a018f7a402bf36777b8b04577: 2023-02-08 02:55:50,155 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:50,155 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:50,155 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:50,155 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:50,155 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 02:55:50,155 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-08 02:55:50,195 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:50,195 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:50,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:50,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:50,196 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:50,196 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:50,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:50,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:50,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:50,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 02:55:50,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d193938[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:50,200 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 02:55:50,201 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,206 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,206 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 02:55:50,206 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-08 02:55:50,206 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:50,207 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:50,207 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:50,216 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 02:55:50,216 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:50,216 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:50,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:50,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:50,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:50,217 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-08 02:55:50,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:50,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:50,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:50,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:50,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:50,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:50,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:55:50,224 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-08 02:55:50,224 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:50,224 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:50,224 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,224 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:50,237 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,237 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:50,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:50,237 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:50,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,238 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:50,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:50,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:50,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:50,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:50,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,239 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:50,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:50,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:50,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:50,248 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:50,248 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:50,248 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 02:55:50,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:50,248 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:50,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:50,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:50,248 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:50,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 02:55:50,248 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,248 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:50,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:50,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:50,249 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:50,248 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:50,249 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,249 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,249 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,349 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:50,349 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:50,349 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:50,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:50,357 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:50,357 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:50,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:50,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:50,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,361 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 02:55:50,361 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:50,361 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 02:55:50,361 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 02:55:50,362 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,362 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,439 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:50,439 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:50,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:50,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:50,441 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:50,441 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:50,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,443 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:50,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,444 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,445 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 02:55:50,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:50,445 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 02:55:50,445 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:50,445 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 02:55:50,446 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:50,446 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:50,446 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:50,446 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. started... 2023-02-08 02:55:50,446 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 88d8f58a018f7a402bf36777b8b04577 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:50,866 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201dad47fc21c274f9d924809e8e1d12920 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201dad47fc21c274f9d924809e8e1d12920 2023-02-08 02:55:51,273 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp/family1/b0940b025f7c4941bbe4a5dadd2129c9 2023-02-08 02:55:51,282 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp/family1/b0940b025f7c4941bbe4a5dadd2129c9 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/b0940b025f7c4941bbe4a5dadd2129c9 2023-02-08 02:55:51,289 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/b0940b025f7c4941bbe4a5dadd2129c9, entries=1, sequenceid=13, filesize=4.9 K 2023-02-08 02:55:51,290 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 88d8f58a018f7a402bf36777b8b04577 in 844ms, sequenceid=13, compaction requested=true 2023-02-08 02:55:51,290 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 88d8f58a018f7a402bf36777b8b04577: 2023-02-08 02:55:51,290 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:51,290 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:51,290 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:51,290 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:51,290 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 02:55:51,290 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-08 02:55:51,319 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,319 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:51,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:51,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:51,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:51,320 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,320 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:51,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:51,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:51,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:51,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:51,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 02:55:51,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4668e429[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:51,321 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 02:55:51,321 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,340 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,341 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 02:55:51,341 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-08 02:55:51,341 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:51,341 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:51,341 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:51,362 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 02:55:51,362 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:51,362 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:51,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:51,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:51,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:51,362 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-08 02:55:51,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:51,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:51,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:51,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:51,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:51,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:51,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:55:51,365 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-08 02:55:51,365 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:51,365 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:51,365 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,365 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:51,412 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,412 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,412 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:51,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:51,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:51,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:51,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:51,413 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:51,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:51,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:51,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,413 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:51,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:51,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:51,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:51,437 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:51,437 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:51,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:51,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 02:55:51,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:51,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 02:55:51,437 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:51,437 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,437 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:51,438 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:51,438 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:51,438 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:51,438 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:51,438 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:51,438 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,438 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,538 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:51,538 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:51,538 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:51,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:51,542 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:51,542 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:51,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:51,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:51,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,544 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 02:55:51,544 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:51,544 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 02:55:51,544 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 02:55:51,545 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,545 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,553 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:51,553 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:51,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:51,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:51,553 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:51,554 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:51,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:51,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,554 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,555 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 02:55:51,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:51,555 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 02:55:51,555 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:51,555 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 02:55:51,555 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:51,555 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:51,555 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:51,555 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. started... 2023-02-08 02:55:51,555 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 88d8f58a018f7a402bf36777b8b04577 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:51,570 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120580b81bd70c5a44edb5f408ecd88d9617 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120580b81bd70c5a44edb5f408ecd88d9617 2023-02-08 02:55:51,976 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp/family1/aa08832679b040a58b6f8aa82be6e480 2023-02-08 02:55:51,982 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp/family1/aa08832679b040a58b6f8aa82be6e480 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/aa08832679b040a58b6f8aa82be6e480 2023-02-08 02:55:51,988 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/aa08832679b040a58b6f8aa82be6e480, entries=1, sequenceid=17, filesize=4.9 K 2023-02-08 02:55:51,989 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 88d8f58a018f7a402bf36777b8b04577 in 434ms, sequenceid=17, compaction requested=true 2023-02-08 02:55:51,989 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 88d8f58a018f7a402bf36777b8b04577: 2023-02-08 02:55:51,989 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:51,989 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:51,989 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:51,990 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:51,990 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 02:55:51,990 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-08 02:55:52,037 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:52,037 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:52,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:52,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:52,038 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,038 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:52,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:52,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:52,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:52,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:52,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 02:55:52,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48a9910d[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:52,040 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 02:55:52,040 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,048 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,048 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 02:55:52,048 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-08 02:55:52,048 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:52,048 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:52,048 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:52,058 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 02:55:52,058 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:52,058 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-08 02:55:52,058 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:52,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:52,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:52,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:52,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:52,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:52,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:52,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:52,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:52,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:52,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:55:52,064 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-08 02:55:52,064 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:52,065 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:52,065 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,065 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:52,077 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,078 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,078 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:52,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:52,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:52,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:52,079 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:52,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:52,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:52,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,083 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:52,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:52,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:52,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:52,089 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:52,090 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:52,090 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,090 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:52,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 02:55:52,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:52,090 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,090 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:52,090 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,090 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:52,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:52,090 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:52,090 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:52,090 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:52,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 02:55:52,090 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:52,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:52,190 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:52,191 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:52,191 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:52,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:52,198 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:52,198 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:52,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:52,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:52,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,203 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 02:55:52,203 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:52,203 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 02:55:52,203 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 02:55:52,204 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,204 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,216 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:52,216 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:52,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:52,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:52,217 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:52,217 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:52,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,218 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:52,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,220 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,220 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 02:55:52,220 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:52,220 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 02:55:52,220 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:52,220 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 02:55:52,221 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:52,221 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:52,221 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:52,221 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. started... 2023-02-08 02:55:52,221 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 88d8f58a018f7a402bf36777b8b04577 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:52,642 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512285b0d1e70d2f44d49be246df403662d74 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512285b0d1e70d2f44d49be246df403662d74 2023-02-08 02:55:53,065 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp/family1/9e500b7583cb4fdf90f8cc3787e5ee6a 2023-02-08 02:55:53,070 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp/family1/9e500b7583cb4fdf90f8cc3787e5ee6a as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/9e500b7583cb4fdf90f8cc3787e5ee6a 2023-02-08 02:55:53,075 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/9e500b7583cb4fdf90f8cc3787e5ee6a, entries=1, sequenceid=21, filesize=4.9 K 2023-02-08 02:55:53,076 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 88d8f58a018f7a402bf36777b8b04577 in 855ms, sequenceid=21, compaction requested=true 2023-02-08 02:55:53,076 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 88d8f58a018f7a402bf36777b8b04577: 2023-02-08 02:55:53,076 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:53,076 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:53,076 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:53,076 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:53,076 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 02:55:53,076 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-08 02:55:53,088 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:53,088 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:53,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:53,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:53,088 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,088 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:53,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:53,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:53,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:53,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:53,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 02:55:53,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29f88345[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:53,091 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 02:55:53,091 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,100 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,100 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 02:55:53,100 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:53,100 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:53,100 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-08 02:55:53,100 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:53,111 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:53,111 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 02:55:53,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:53,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:53,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:53,111 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:53,111 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-08 02:55:53,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:53,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:53,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:53,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:53,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:53,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:53,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:55:53,115 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-08 02:55:53,115 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:53,115 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:53,115 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,115 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:53,121 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,121 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:53,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,121 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:53,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:53,122 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:53,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:53,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:53,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:53,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:53,123 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:53,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:53,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:53,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,132 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:53,132 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:53,132 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:53,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 02:55:53,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:53,132 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:53,132 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:53,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:53,132 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:53,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 02:55:53,132 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,132 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:53,132 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:53,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:53,133 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:53,133 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,133 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,233 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:53,233 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:53,233 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:53,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:53,238 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:53,238 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:53,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:53,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:53,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,240 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 02:55:53,240 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:53,240 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 02:55:53,241 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 02:55:53,241 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,241 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,256 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:53,256 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:53,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:53,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:53,257 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:53,257 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:53,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,257 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:53,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,257 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,263 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 02:55:53,263 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:53,263 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 02:55:53,263 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:53,263 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 02:55:53,263 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:53,263 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:53,263 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:53,264 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. started... 2023-02-08 02:55:53,264 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 88d8f58a018f7a402bf36777b8b04577 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:53,346 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 02:55:53,681 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231f8fdfe7b99c848ff940e60f6527ca8fc to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231f8fdfe7b99c848ff940e60f6527ca8fc 2023-02-08 02:55:54,088 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp/family1/2f1766856b1641988e25ff43f019f5e6 2023-02-08 02:55:54,095 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp/family1/2f1766856b1641988e25ff43f019f5e6 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/2f1766856b1641988e25ff43f019f5e6 2023-02-08 02:55:54,102 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/2f1766856b1641988e25ff43f019f5e6, entries=1, sequenceid=25, filesize=4.9 K 2023-02-08 02:55:54,103 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 88d8f58a018f7a402bf36777b8b04577 in 839ms, sequenceid=25, compaction requested=true 2023-02-08 02:55:54,103 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 88d8f58a018f7a402bf36777b8b04577: 2023-02-08 02:55:54,103 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:54,103 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:54,103 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:54,103 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:54,104 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 02:55:54,104 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-08 02:55:54,121 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:54,121 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:54,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:54,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:54,122 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:54,122 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:54,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:54,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:54,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:54,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 02:55:54,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7dfcbfbb[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:54,126 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 02:55:54,126 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,132 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,132 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 02:55:54,132 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-08 02:55:54,132 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:54,132 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:54,132 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:54,175 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 02:55:54,175 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:54,176 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-08 02:55:54,175 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:54,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:54,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:54,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:54,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:54,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:54,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:54,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:54,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:54,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:54,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:55:54,180 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-08 02:55:54,180 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:54,180 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:54,180 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,180 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:54,195 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,195 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:54,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:54,195 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:54,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:54,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:54,196 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:54,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:54,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:54,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,198 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:54,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:54,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:54,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:54,205 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:54,205 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:54,205 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,206 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:54,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 02:55:54,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 02:55:54,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:54,206 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:54,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:54,206 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:54,207 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:54,206 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:54,207 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:54,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:54,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:54,207 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,208 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,208 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,307 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:54,307 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:54,308 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:54,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:54,312 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:54,312 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:54,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:54,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:54,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,314 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 02:55:54,314 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:54,315 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 02:55:54,315 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 02:55:54,315 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,315 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,321 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:54,321 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:54,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:54,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:54,321 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:54,321 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:54,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,322 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:54,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,322 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,322 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 02:55:54,322 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:54,322 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 02:55:54,322 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:54,323 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 02:55:54,323 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:54,323 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:54,323 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:54,323 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. started... 2023-02-08 02:55:54,323 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 88d8f58a018f7a402bf36777b8b04577 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:54,742 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101572098e1a6f94802a3d2d00a7ba3edb5 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101572098e1a6f94802a3d2d00a7ba3edb5 2023-02-08 02:55:55,150 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp/family1/3291157b61da489799079f8d925c6d0c 2023-02-08 02:55:55,156 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp/family1/3291157b61da489799079f8d925c6d0c as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/3291157b61da489799079f8d925c6d0c 2023-02-08 02:55:55,160 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/3291157b61da489799079f8d925c6d0c, entries=1, sequenceid=29, filesize=4.9 K 2023-02-08 02:55:55,160 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 88d8f58a018f7a402bf36777b8b04577 in 837ms, sequenceid=29, compaction requested=true 2023-02-08 02:55:55,161 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 88d8f58a018f7a402bf36777b8b04577: 2023-02-08 02:55:55,161 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:55,161 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:55,161 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:55,161 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:55,161 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 02:55:55,161 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-08 02:55:55,174 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,174 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:55,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:55,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:55,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:55,174 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,174 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:55,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:55,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:55,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:55,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:55,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 02:55:55,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cb45581[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:55,176 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 02:55:55,176 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,184 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,185 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 02:55:55,185 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-08 02:55:55,185 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:55,185 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:55,185 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:55,195 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 02:55:55,195 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:55,195 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-08 02:55:55,195 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:55,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:55,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:55,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:55,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:55,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:55,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:55,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:55,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:55,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:55,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:55:55,198 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-08 02:55:55,198 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:55,198 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:55,198 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,198 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:55,205 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,205 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,205 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:55,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:55,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:55,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:55,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:55,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:55,206 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:55,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:55,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:55,207 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:55,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:55,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:55,216 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:55,216 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:55,216 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:55,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:55,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 02:55:55,216 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,216 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:55,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 02:55:55,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:55,216 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:55,216 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:55,216 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,216 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:55,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:55,216 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:55,216 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:55,216 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,317 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:55,317 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:55,317 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:55,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:55,322 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:55,322 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:55,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:55,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:55,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,324 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 02:55:55,324 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:55,325 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 02:55:55,325 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 02:55:55,325 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,325 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,331 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:55,331 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:55,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:55,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:55,332 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:55,332 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:55,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:55,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,333 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,333 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 02:55:55,333 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:55,333 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 02:55:55,333 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:55,333 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 02:55:55,333 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:55,333 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:55,333 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:55,334 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. started... 2023-02-08 02:55:55,334 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 88d8f58a018f7a402bf36777b8b04577 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:55,752 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103abbcc601f39b4600a199ebed3d32f809 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103abbcc601f39b4600a199ebed3d32f809 2023-02-08 02:55:56,158 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp/family1/f138d8943ec9423e9b97e62386312689 2023-02-08 02:55:56,163 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp/family1/f138d8943ec9423e9b97e62386312689 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/f138d8943ec9423e9b97e62386312689 2023-02-08 02:55:56,168 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/f138d8943ec9423e9b97e62386312689, entries=1, sequenceid=33, filesize=4.9 K 2023-02-08 02:55:56,169 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 88d8f58a018f7a402bf36777b8b04577 in 835ms, sequenceid=33, compaction requested=true 2023-02-08 02:55:56,169 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 88d8f58a018f7a402bf36777b8b04577: 2023-02-08 02:55:56,169 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:56,169 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:56,170 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:56,170 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:56,170 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 02:55:56,170 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-08 02:55:56,184 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:56,184 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:56,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:56,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:56,185 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,185 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:56,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:56,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:56,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:56,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:56,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 02:55:56,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@781182e3[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:56,186 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 02:55:56,186 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,195 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,195 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 02:55:56,195 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:56,195 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:56,195 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-08 02:55:56,195 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:56,205 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 02:55:56,205 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:56,205 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:56,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:56,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:56,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:56,205 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-08 02:55:56,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:56,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:56,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:56,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:56,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:56,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:56,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:55:56,208 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-08 02:55:56,208 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:56,208 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:56,208 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,208 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:56,216 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,216 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,216 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:56,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:56,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:56,216 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:56,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:56,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:56,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:56,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:56,217 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:56,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:56,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:56,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:56,301 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:56,301 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:56,301 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:56,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:56,301 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:56,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:56,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 02:55:56,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:56,301 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 02:55:56,302 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,302 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:56,302 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,302 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,302 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,302 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:56,302 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:56,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:56,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:56,402 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:56,402 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:56,402 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:56,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:56,407 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:56,407 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:56,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:56,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:56,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,410 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 02:55:56,410 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:56,410 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 02:55:56,410 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 02:55:56,411 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,411 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,437 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:56,437 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:56,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:56,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:56,437 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:56,437 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:56,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,438 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:56,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,438 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,438 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 02:55:56,438 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:56,438 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 02:55:56,438 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:56,438 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 02:55:56,439 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:56,439 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:56,439 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:56,439 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. started... 2023-02-08 02:55:56,439 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 88d8f58a018f7a402bf36777b8b04577 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:56,463 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509071852636b32df42ec9a46883adfd039da to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201509071852636b32df42ec9a46883adfd039da 2023-02-08 02:55:56,874 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp/family1/43d4994f3ae8449da304d98a7d6356f4 2023-02-08 02:55:56,885 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp/family1/43d4994f3ae8449da304d98a7d6356f4 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/43d4994f3ae8449da304d98a7d6356f4 2023-02-08 02:55:56,890 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/43d4994f3ae8449da304d98a7d6356f4, entries=1, sequenceid=37, filesize=4.9 K 2023-02-08 02:55:56,891 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 88d8f58a018f7a402bf36777b8b04577 in 452ms, sequenceid=37, compaction requested=true 2023-02-08 02:55:56,891 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 88d8f58a018f7a402bf36777b8b04577: 2023-02-08 02:55:56,891 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:56,891 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:56,891 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:56,891 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:56,891 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 02:55:56,891 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-08 02:55:57,030 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:57,030 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:57,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:57,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:57,031 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,031 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:57,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:57,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:57,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:57,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:57,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 02:55:57,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@159ed40f[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:57,033 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 02:55:57,033 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,104 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,105 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 02:55:57,105 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-08 02:55:57,105 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:57,105 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:57,105 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:57,121 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 02:55:57,121 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:57,121 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:57,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:57,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:57,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:57,121 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-08 02:55:57,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:57,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:57,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:57,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:57,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:57,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:57,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:55:57,123 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-08 02:55:57,123 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:57,123 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:57,123 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,123 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:57,131 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,131 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:57,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:57,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,131 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:57,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:57,132 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:57,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:57,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:57,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:57,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,133 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:57,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:57,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:57,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:57,142 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:57,142 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:57,142 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:57,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 02:55:57,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:57,142 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:57,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:57,142 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:57,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 02:55:57,142 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,142 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:57,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:57,143 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:57,143 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:57,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:57,143 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,143 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,143 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,243 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:57,243 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:57,243 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:57,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:57,250 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:57,250 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:57,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:55:57,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:55:57,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,255 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 02:55:57,255 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:57,255 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 02:55:57,255 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 02:55:57,256 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,256 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,294 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:57,294 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:57,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:57,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:57,295 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:57,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,295 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:55:57,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:55:57,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,296 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,297 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 02:55:57,297 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:57,297 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 02:55:57,297 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:55:57,297 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 02:55:57,297 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:55:57,298 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:55:57,298 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:57,298 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. started... 2023-02-08 02:55:57,298 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 88d8f58a018f7a402bf36777b8b04577 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:55:57,716 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511209f920bd96fd540e0b6e8ab6646431fbe to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511209f920bd96fd540e0b6e8ab6646431fbe 2023-02-08 02:55:58,125 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp/family1/7529d16c72a54ac785185f0c2d99d81f 2023-02-08 02:55:58,131 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp/family1/7529d16c72a54ac785185f0c2d99d81f as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/7529d16c72a54ac785185f0c2d99d81f 2023-02-08 02:55:58,136 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/7529d16c72a54ac785185f0c2d99d81f, entries=1, sequenceid=41, filesize=4.9 K 2023-02-08 02:55:58,137 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 88d8f58a018f7a402bf36777b8b04577 in 839ms, sequenceid=41, compaction requested=true 2023-02-08 02:55:58,137 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 88d8f58a018f7a402bf36777b8b04577: 2023-02-08 02:55:58,137 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:58,137 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:55:58,137 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:55:58,137 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:58,137 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 02:55:58,137 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-08 02:55:58,152 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,152 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:58,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:58,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:58,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:58,153 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,153 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:55:58,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:58,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:58,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:58,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:58,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 02:55:58,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d07a060[Count = 0] remaining members to acquire global barrier 2023-02-08 02:55:58,154 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 02:55:58,154 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,163 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,163 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:58,163 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:55:58,163 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 02:55:58,163 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-08 02:55:58,163 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:55:58,173 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 02:55:58,174 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:58,173 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:58,174 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-08 02:55:58,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:58,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:58,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:58,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:58,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:58,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:58,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:58,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:58,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:55:58,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:55:58,176 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-08 02:55:58,176 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:55:58,176 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:55:58,176 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,176 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:55:58,184 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,184 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:58,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,184 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:55:58,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:55:58,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:58,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:58,185 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:58,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:55:58,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:55:58,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,186 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:58,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:58,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:55:58,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:58,195 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:55:58,195 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:58,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:55:58,195 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:55:58,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:55:58,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 02:55:58,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:55:58,195 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:55:58,195 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,195 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,195 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:55:58,195 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:55:58,195 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:55:58,195 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,195 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:55:58,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 02:55:58,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:55:58,195 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,295 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:55:58,296 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:58,296 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:55:58,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:55:58,298 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-02-08 02:55:58,300 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 02:55:58,300 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 02:55:58,301 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675825558301 2023-02-08 02:55:58,302 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:55:58,304 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-08 02:55:58,306 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-08 02:55:58,306 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 02:55:58,306 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] zookeeper.ReadOnlyZKClient(139): Connect 0x7a2e5c79 to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:55:58,322 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b44c745, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:55:58,322 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 02:55:59,181 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103dd6751b8e2d340789a0a3ff53ddf98e3 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103dd6751b8e2d340789a0a3ff53ddf98e3 2023-02-08 02:55:59,182 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 02:55:59,193 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 02:55:59,194 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:36374, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 02:55:59,199 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:59,200 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:55:59,200 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 02:55:59,202 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:45258, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 02:55:59,213 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f54affaf8b85441bb37e4349fbdf8e1c first=Optional[r3] last=Optional[r6] 2023-02-08 02:55:59,214 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f54affaf8b85441bb37e4349fbdf8e1c}] 2023-02-08 02:55:59,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f54affaf8b85441bb37e4349fbdf8e1c for inclusion in 88d8f58a018f7a402bf36777b8b04577/family1 2023-02-08 02:55:59,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-08 02:55:59,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 02:55:59,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for 88d8f58a018f7a402bf36777b8b04577: 2023-02-08 02:55:59,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f54affaf8b85441bb37e4349fbdf8e1c to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithWeeklyPolicy__aquo8dilp6jchgei07e6782vikv7mq10h1su1r8irectm842h8spte3knedeaud0/family1/f54affaf8b85441bb37e4349fbdf8e1c 2023-02-08 02:55:59,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithWeeklyPolicy__aquo8dilp6jchgei07e6782vikv7mq10h1su1r8irectm842h8spte3knedeaud0/family1/f54affaf8b85441bb37e4349fbdf8e1c as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/eeb24319088f4cd08de09266ac17ee07_SeqId_44_ 2023-02-08 02:55:59,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithWeeklyPolicy__aquo8dilp6jchgei07e6782vikv7mq10h1su1r8irectm842h8spte3knedeaud0/family1/f54affaf8b85441bb37e4349fbdf8e1c into 88d8f58a018f7a402bf36777b8b04577/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/eeb24319088f4cd08de09266ac17ee07_SeqId_44_ - updating store file list. 2023-02-08 02:55:59,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/eeb24319088f4cd08de09266ac17ee07_SeqId_44_ into 88d8f58a018f7a402bf36777b8b04577/family1 2023-02-08 02:55:59,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithWeeklyPolicy__aquo8dilp6jchgei07e6782vikv7mq10h1su1r8irectm842h8spte3knedeaud0/family1/f54affaf8b85441bb37e4349fbdf8e1c into 88d8f58a018f7a402bf36777b8b04577/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/eeb24319088f4cd08de09266ac17ee07_SeqId_44_) 2023-02-08 02:55:59,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithWeeklyPolicy__aquo8dilp6jchgei07e6782vikv7mq10h1su1r8irectm842h8spte3knedeaud0/family1/f54affaf8b85441bb37e4349fbdf8e1c 2023-02-08 02:55:59,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-08 02:55:59,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-08 02:55:59,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(1912): 88d8f58a018f7a402bf36777b8b04577/family1 is initiating minor compaction 2023-02-08 02:55:59,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2f9f0f3d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:55:59,239 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 88d8f58a018f7a402bf36777b8b04577/family1 in testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:55:59,239 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/c113f35db94e4fe68ce8e6492d48956c, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/b0940b025f7c4941bbe4a5dadd2129c9, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/aa08832679b040a58b6f8aa82be6e480, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/9e500b7583cb4fdf90f8cc3787e5ee6a, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/2f1766856b1641988e25ff43f019f5e6, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/3291157b61da489799079f8d925c6d0c, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/f138d8943ec9423e9b97e62386312689, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/43d4994f3ae8449da304d98a7d6356f4, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/7529d16c72a54ac785185f0c2d99d81f, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/eeb24319088f4cd08de09266ac17ee07_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp, totalSize=50.0 K 2023-02-08 02:55:59,239 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting c113f35db94e4fe68ce8e6492d48956c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-08 02:55:59,239 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting b0940b025f7c4941bbe4a5dadd2129c9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-08 02:55:59,239 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting aa08832679b040a58b6f8aa82be6e480, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-08 02:55:59,239 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 9e500b7583cb4fdf90f8cc3787e5ee6a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-08 02:55:59,239 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 2f1766856b1641988e25ff43f019f5e6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-08 02:55:59,239 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 3291157b61da489799079f8d925c6d0c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-08 02:55:59,239 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting f138d8943ec9423e9b97e62386312689, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-08 02:55:59,240 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 43d4994f3ae8449da304d98a7d6356f4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-08 02:55:59,240 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 7529d16c72a54ac785185f0c2d99d81f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-08 02:55:59,240 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting eeb24319088f4cd08de09266ac17ee07_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-08 02:55:59,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 02:55:59,242 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:55:59,243 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512285b0d1e70d2f44d49be246df403662d74 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512285b0d1e70d2f44d49be246df403662d74 2023-02-08 02:55:59,244 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231f8fdfe7b99c848ff940e60f6527ca8fc to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231f8fdfe7b99c848ff940e60f6527ca8fc 2023-02-08 02:55:59,246 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101572098e1a6f94802a3d2d00a7ba3edb5 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101572098e1a6f94802a3d2d00a7ba3edb5 2023-02-08 02:55:59,247 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103abbcc601f39b4600a199ebed3d32f809 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103abbcc601f39b4600a199ebed3d32f809 2023-02-08 02:55:59,247 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-08 02:55:59,247 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-08 02:55:59,247 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 02:55:59,247 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 02:55:59,247 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 02:55:59,247 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 02:55:59,247 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 02:55:59,247 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 02:55:59,248 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 02:55:59,248 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 02:55:59,271 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] throttle.PressureAwareThroughputController(145): 88d8f58a018f7a402bf36777b8b04577#family1#compaction#34 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:56:00,088 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c7b30b9cc61e4b11a7693a982623cae1 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205c7b30b9cc61e4b11a7693a982623cae1 2023-02-08 02:56:00,089 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp/family1/558c7a5a275b427983dca23e4918dca5 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/558c7a5a275b427983dca23e4918dca5 2023-02-08 02:56:00,089 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 02:56:00,102 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 88d8f58a018f7a402bf36777b8b04577/family1 of 88d8f58a018f7a402bf36777b8b04577 into 558c7a5a275b427983dca23e4918dca5(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 02:56:00,102 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 88d8f58a018f7a402bf36777b8b04577: 2023-02-08 02:56:00,102 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1675824959238; duration=0sec 2023-02-08 02:56:00,102 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:56:00,108 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:00,108 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:00,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/c113f35db94e4fe68ce8e6492d48956c, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/b0940b025f7c4941bbe4a5dadd2129c9, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/aa08832679b040a58b6f8aa82be6e480, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/9e500b7583cb4fdf90f8cc3787e5ee6a, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/2f1766856b1641988e25ff43f019f5e6, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/3291157b61da489799079f8d925c6d0c, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/f138d8943ec9423e9b97e62386312689, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/43d4994f3ae8449da304d98a7d6356f4, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/7529d16c72a54ac785185f0c2d99d81f, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/eeb24319088f4cd08de09266ac17ee07_SeqId_44_] to archive 2023-02-08 02:56:00,121 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:56:00,123 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/c113f35db94e4fe68ce8e6492d48956c to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/c113f35db94e4fe68ce8e6492d48956c 2023-02-08 02:56:00,124 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c06a0941bcdb4c95a2c9f72927e70311 first=Optional[r1] last=Optional[r2] 2023-02-08 02:56:00,125 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c06a0941bcdb4c95a2c9f72927e70311}] 2023-02-08 02:56:00,125 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/b0940b025f7c4941bbe4a5dadd2129c9 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/b0940b025f7c4941bbe4a5dadd2129c9 2023-02-08 02:56:00,126 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/aa08832679b040a58b6f8aa82be6e480 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/aa08832679b040a58b6f8aa82be6e480 2023-02-08 02:56:00,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c06a0941bcdb4c95a2c9f72927e70311 for inclusion in 88d8f58a018f7a402bf36777b8b04577/family1 2023-02-08 02:56:00,127 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/9e500b7583cb4fdf90f8cc3787e5ee6a to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/9e500b7583cb4fdf90f8cc3787e5ee6a 2023-02-08 02:56:00,129 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/2f1766856b1641988e25ff43f019f5e6 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/2f1766856b1641988e25ff43f019f5e6 2023-02-08 02:56:00,130 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/3291157b61da489799079f8d925c6d0c to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/3291157b61da489799079f8d925c6d0c 2023-02-08 02:56:00,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-08 02:56:00,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 02:56:00,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for 88d8f58a018f7a402bf36777b8b04577: 2023-02-08 02:56:00,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c06a0941bcdb4c95a2c9f72927e70311 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithWeeklyPolicy__m8jan4kcavgp02jh0mm7apfo07efabc6a07inp0fed9e8gtioh39uoelqpnkkm3k/family1/c06a0941bcdb4c95a2c9f72927e70311 2023-02-08 02:56:00,133 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/f138d8943ec9423e9b97e62386312689 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/f138d8943ec9423e9b97e62386312689 2023-02-08 02:56:00,134 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/43d4994f3ae8449da304d98a7d6356f4 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/43d4994f3ae8449da304d98a7d6356f4 2023-02-08 02:56:00,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithWeeklyPolicy__m8jan4kcavgp02jh0mm7apfo07efabc6a07inp0fed9e8gtioh39uoelqpnkkm3k/family1/c06a0941bcdb4c95a2c9f72927e70311 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/9acb63ca937541e2a568fdb5b41ab2b2_SeqId_47_ 2023-02-08 02:56:00,136 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/7529d16c72a54ac785185f0c2d99d81f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/7529d16c72a54ac785185f0c2d99d81f 2023-02-08 02:56:00,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithWeeklyPolicy__m8jan4kcavgp02jh0mm7apfo07efabc6a07inp0fed9e8gtioh39uoelqpnkkm3k/family1/c06a0941bcdb4c95a2c9f72927e70311 into 88d8f58a018f7a402bf36777b8b04577/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/9acb63ca937541e2a568fdb5b41ab2b2_SeqId_47_ - updating store file list. 2023-02-08 02:56:00,137 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/eeb24319088f4cd08de09266ac17ee07_SeqId_44_ to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/eeb24319088f4cd08de09266ac17ee07_SeqId_44_ 2023-02-08 02:56:00,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/9acb63ca937541e2a568fdb5b41ab2b2_SeqId_47_ into 88d8f58a018f7a402bf36777b8b04577/family1 2023-02-08 02:56:00,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithWeeklyPolicy__m8jan4kcavgp02jh0mm7apfo07efabc6a07inp0fed9e8gtioh39uoelqpnkkm3k/family1/c06a0941bcdb4c95a2c9f72927e70311 into 88d8f58a018f7a402bf36777b8b04577/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/9acb63ca937541e2a568fdb5b41ab2b2_SeqId_47_) 2023-02-08 02:56:00,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithWeeklyPolicy__m8jan4kcavgp02jh0mm7apfo07efabc6a07inp0fed9e8gtioh39uoelqpnkkm3k/family1/c06a0941bcdb4c95a2c9f72927e70311 2023-02-08 02:56:00,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-08 02:56:00,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-08 02:56:00,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(1912): 88d8f58a018f7a402bf36777b8b04577/family1 is initiating minor compaction (all files) 2023-02-08 02:56:00,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5cde0bf5; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:56:00,143 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 88d8f58a018f7a402bf36777b8b04577/family1 in testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:56:00,143 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/e16cf2aa8a104bc6a9568e502fb9418f, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/558c7a5a275b427983dca23e4918dca5, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/9acb63ca937541e2a568fdb5b41ab2b2_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp, totalSize=176.8 K 2023-02-08 02:56:00,144 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting e16cf2aa8a104bc6a9568e502fb9418f, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878815769 2023-02-08 02:56:00,144 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 558c7a5a275b427983dca23e4918dca5, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621215769 2023-02-08 02:56:00,145 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 9acb63ca937541e2a568fdb5b41ab2b2_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965215769 2023-02-08 02:56:00,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 02:56:00,146 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:56:00,147 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201dad47fc21c274f9d924809e8e1d12920 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201dad47fc21c274f9d924809e8e1d12920 2023-02-08 02:56:00,148 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120580b81bd70c5a44edb5f408ecd88d9617 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120580b81bd70c5a44edb5f408ecd88d9617 2023-02-08 02:56:00,148 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-02-08 02:56:00,148 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-08 02:56:00,149 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 02:56:00,149 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 02:56:00,149 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:56:00,150 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 02:56:00,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8510 sec 2023-02-08 02:56:00,163 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] throttle.PressureAwareThroughputController(145): 88d8f58a018f7a402bf36777b8b04577#family1#compaction#35 average throughput is 17.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:56:00,248 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=249 (was 257), OpenFileDescriptor=587 (was 617), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=229 (was 235), ProcessCount=173 (was 172) - ProcessCount LEAK? -, AvailableMemoryMB=3951 (was 3511) - AvailableMemoryMB LEAK? - 2023-02-08 02:56:00,259 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=249, OpenFileDescriptor=587, MaxFileDescriptor=60000, SystemLoadAverage=229, ProcessCount=173, AvailableMemoryMB=3950 2023-02-08 02:56:00,260 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:00,260 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:00,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-08 02:56:00,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:00,264 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 02:56:00,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-02-08 02:56:00,265 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:00,265 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:00,265 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 02:56:00,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-08 02:56:00,267 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testScannerOnBulkLoadRefHFiles/7b12968f53863f14d4d88e1e87d68b1d 2023-02-08 02:56:00,267 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testScannerOnBulkLoadRefHFiles/f95ae31c0549207e908fd449732ddbfb 2023-02-08 02:56:00,267 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f 2023-02-08 02:56:00,268 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testScannerOnBulkLoadRefHFiles/7b12968f53863f14d4d88e1e87d68b1d empty. 2023-02-08 02:56:00,268 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testScannerOnBulkLoadRefHFiles/f95ae31c0549207e908fd449732ddbfb empty. 2023-02-08 02:56:00,268 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f empty. 2023-02-08 02:56:00,268 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testScannerOnBulkLoadRefHFiles/7b12968f53863f14d4d88e1e87d68b1d 2023-02-08 02:56:00,268 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testScannerOnBulkLoadRefHFiles/f95ae31c0549207e908fd449732ddbfb 2023-02-08 02:56:00,268 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f 2023-02-08 02:56:00,268 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-02-08 02:56:00,366 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:00,366 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:00,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-08 02:56:00,568 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:00,568 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:00,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-08 02:56:00,676 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-02-08 02:56:00,677 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7b12968f53863f14d4d88e1e87d68b1d, NAME => 'testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp 2023-02-08 02:56:00,678 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7671): creating {ENCODED => 6629972f379f1aeea9b891f6609ea66f, NAME => 'testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp 2023-02-08 02:56:00,678 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7671): creating {ENCODED => f95ae31c0549207e908fd449732ddbfb, NAME => 'testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp 2023-02-08 02:56:00,870 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:00,870 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:00,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-08 02:56:00,987 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/.tmp/family1/708600a47f334c2fbe50d5b441965536 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/708600a47f334c2fbe50d5b441965536 2023-02-08 02:56:00,992 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 88d8f58a018f7a402bf36777b8b04577/family1 of 88d8f58a018f7a402bf36777b8b04577 into 708600a47f334c2fbe50d5b441965536(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 02:56:00,992 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 88d8f58a018f7a402bf36777b8b04577: 2023-02-08 02:56:00,993 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1675824960143; duration=0sec 2023-02-08 02:56:00,993 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:56:01,014 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/e16cf2aa8a104bc6a9568e502fb9418f, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/558c7a5a275b427983dca23e4918dca5, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/9acb63ca937541e2a568fdb5b41ab2b2_SeqId_47_] to archive 2023-02-08 02:56:01,015 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:56:01,017 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/e16cf2aa8a104bc6a9568e502fb9418f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/e16cf2aa8a104bc6a9568e502fb9418f 2023-02-08 02:56:01,018 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/558c7a5a275b427983dca23e4918dca5 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/558c7a5a275b427983dca23e4918dca5 2023-02-08 02:56:01,020 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/9acb63ca937541e2a568fdb5b41ab2b2_SeqId_47_ to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/family1/9acb63ca937541e2a568fdb5b41ab2b2_SeqId_47_ 2023-02-08 02:56:01,087 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:56:01,087 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1603): Closing f95ae31c0549207e908fd449732ddbfb, disabling compactions & flushes 2023-02-08 02:56:01,087 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb. 2023-02-08 02:56:01,087 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb. 2023-02-08 02:56:01,087 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb. after waiting 0 ms 2023-02-08 02:56:01,087 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb. 2023-02-08 02:56:01,087 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb. 2023-02-08 02:56:01,087 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1557): Region close journal for f95ae31c0549207e908fd449732ddbfb: Waiting for close lock at 1675824961087Disabling compacts and flushes for region at 1675824961087Disabling writes for close at 1675824961087Writing region close event to WAL at 1675824961087Closed at 1675824961087 2023-02-08 02:56:01,090 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:56:01,091 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1603): Closing 6629972f379f1aeea9b891f6609ea66f, disabling compactions & flushes 2023-02-08 02:56:01,091 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f. 2023-02-08 02:56:01,091 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f. 2023-02-08 02:56:01,091 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f. after waiting 0 ms 2023-02-08 02:56:01,091 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f. 2023-02-08 02:56:01,091 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f. 2023-02-08 02:56:01,091 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1557): Region close journal for 6629972f379f1aeea9b891f6609ea66f: Waiting for close lock at 1675824961091Disabling compacts and flushes for region at 1675824961091Disabling writes for close at 1675824961091Writing region close event to WAL at 1675824961091Closed at 1675824961091 2023-02-08 02:56:01,091 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:56:01,092 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1603): Closing 7b12968f53863f14d4d88e1e87d68b1d, disabling compactions & flushes 2023-02-08 02:56:01,092 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d. 2023-02-08 02:56:01,092 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d. 2023-02-08 02:56:01,092 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d. after waiting 0 ms 2023-02-08 02:56:01,092 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d. 2023-02-08 02:56:01,092 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d. 2023-02-08 02:56:01,092 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1557): Region close journal for 7b12968f53863f14d4d88e1e87d68b1d: Waiting for close lock at 1675824961091Disabling compacts and flushes for region at 1675824961091Disabling writes for close at 1675824961092 (+1 ms)Writing region close event to WAL at 1675824961092Closed at 1675824961092 2023-02-08 02:56:01,094 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 02:56:01,095 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1675824961095"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675824961095"}]},"ts":"1675824961095"} 2023-02-08 02:56:01,095 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675824961095"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675824961095"}]},"ts":"1675824961095"} 2023-02-08 02:56:01,095 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675824961095"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675824961095"}]},"ts":"1675824961095"} 2023-02-08 02:56:01,102 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-08 02:56:01,103 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 02:56:01,103 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675824961103"}]},"ts":"1675824961103"} 2023-02-08 02:56:01,104 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-02-08 02:56:01,142 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=7b12968f53863f14d4d88e1e87d68b1d, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=f95ae31c0549207e908fd449732ddbfb, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6629972f379f1aeea9b891f6609ea66f, ASSIGN}] 2023-02-08 02:56:01,144 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=f95ae31c0549207e908fd449732ddbfb, ASSIGN 2023-02-08 02:56:01,144 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=7b12968f53863f14d4d88e1e87d68b1d, ASSIGN 2023-02-08 02:56:01,144 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6629972f379f1aeea9b891f6609ea66f, ASSIGN 2023-02-08 02:56:01,145 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=f95ae31c0549207e908fd449732ddbfb, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=false 2023-02-08 02:56:01,145 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6629972f379f1aeea9b891f6609ea66f, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=false 2023-02-08 02:56:01,145 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=7b12968f53863f14d4d88e1e87d68b1d, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=false 2023-02-08 02:56:01,297 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=f95ae31c0549207e908fd449732ddbfb, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:01,297 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=7b12968f53863f14d4d88e1e87d68b1d, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:01,297 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=6629972f379f1aeea9b891f6609ea66f, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:01,297 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1675824961296"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675824961296"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675824961296"}]},"ts":"1675824961296"} 2023-02-08 02:56:01,297 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675824961297"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675824961297"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675824961297"}]},"ts":"1675824961297"} 2023-02-08 02:56:01,297 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675824961296"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675824961296"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675824961296"}]},"ts":"1675824961296"} 2023-02-08 02:56:01,299 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure f95ae31c0549207e908fd449732ddbfb, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:56:01,299 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure 7b12968f53863f14d4d88e1e87d68b1d, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:56:01,300 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure 6629972f379f1aeea9b891f6609ea66f, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:56:01,371 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:01,371 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:01,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-08 02:56:01,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d. 2023-02-08 02:56:01,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7b12968f53863f14d4d88e1e87d68b1d, NAME => 'testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d.', STARTKEY => '', ENDKEY => '1'} 2023-02-08 02:56:01,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 7b12968f53863f14d4d88e1e87d68b1d 2023-02-08 02:56:01,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:56:01,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 7b12968f53863f14d4d88e1e87d68b1d 2023-02-08 02:56:01,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 7b12968f53863f14d4d88e1e87d68b1d 2023-02-08 02:56:01,457 INFO [StoreOpener-7b12968f53863f14d4d88e1e87d68b1d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7b12968f53863f14d4d88e1e87d68b1d 2023-02-08 02:56:01,458 DEBUG [StoreOpener-7b12968f53863f14d4d88e1e87d68b1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/7b12968f53863f14d4d88e1e87d68b1d/family1 2023-02-08 02:56:01,458 DEBUG [StoreOpener-7b12968f53863f14d4d88e1e87d68b1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/7b12968f53863f14d4d88e1e87d68b1d/family1 2023-02-08 02:56:01,459 INFO [StoreOpener-7b12968f53863f14d4d88e1e87d68b1d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b12968f53863f14d4d88e1e87d68b1d columnFamilyName family1 2023-02-08 02:56:01,460 INFO [StoreOpener-7b12968f53863f14d4d88e1e87d68b1d-1] regionserver.HStore(310): Store=7b12968f53863f14d4d88e1e87d68b1d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:56:01,461 INFO [StoreOpener-7b12968f53863f14d4d88e1e87d68b1d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7b12968f53863f14d4d88e1e87d68b1d 2023-02-08 02:56:01,462 DEBUG [StoreOpener-7b12968f53863f14d4d88e1e87d68b1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/7b12968f53863f14d4d88e1e87d68b1d/family2 2023-02-08 02:56:01,462 DEBUG [StoreOpener-7b12968f53863f14d4d88e1e87d68b1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/7b12968f53863f14d4d88e1e87d68b1d/family2 2023-02-08 02:56:01,463 INFO [StoreOpener-7b12968f53863f14d4d88e1e87d68b1d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b12968f53863f14d4d88e1e87d68b1d columnFamilyName family2 2023-02-08 02:56:01,464 INFO [StoreOpener-7b12968f53863f14d4d88e1e87d68b1d-1] regionserver.HStore(310): Store=7b12968f53863f14d4d88e1e87d68b1d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:56:01,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/7b12968f53863f14d4d88e1e87d68b1d 2023-02-08 02:56:01,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/7b12968f53863f14d4d88e1e87d68b1d 2023-02-08 02:56:01,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 02:56:01,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 7b12968f53863f14d4d88e1e87d68b1d 2023-02-08 02:56:01,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/7b12968f53863f14d4d88e1e87d68b1d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:56:01,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 7b12968f53863f14d4d88e1e87d68b1d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68580485, jitterRate=0.021928861737251282}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 02:56:01,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 7b12968f53863f14d4d88e1e87d68b1d: Running coprocessor pre-open hook at 1675824961456Writing region info on filesystem at 1675824961456Initializing all the Stores at 1675824961457 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675824961457Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675824961457Cleaning up temporary data from old regions at 1675824961466 (+9 ms)Cleaning up detritus from prior splits at 1675824961467 (+1 ms)Running coprocessor post-open hooks at 1675824961472 (+5 ms)Region opened successfully at 1675824961472 2023-02-08 02:56:01,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d., pid=32, masterSystemTime=1675824961452 2023-02-08 02:56:01,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d. 2023-02-08 02:56:01,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d. 2023-02-08 02:56:01,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb. 2023-02-08 02:56:01,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f95ae31c0549207e908fd449732ddbfb, NAME => 'testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb.', STARTKEY => '1', ENDKEY => '2'} 2023-02-08 02:56:01,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles f95ae31c0549207e908fd449732ddbfb 2023-02-08 02:56:01,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:56:01,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for f95ae31c0549207e908fd449732ddbfb 2023-02-08 02:56:01,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for f95ae31c0549207e908fd449732ddbfb 2023-02-08 02:56:01,479 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=7b12968f53863f14d4d88e1e87d68b1d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:01,479 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675824961479"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675824961479"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675824961479"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675824961479"}]},"ts":"1675824961479"} 2023-02-08 02:56:01,480 INFO [StoreOpener-f95ae31c0549207e908fd449732ddbfb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f95ae31c0549207e908fd449732ddbfb 2023-02-08 02:56:01,482 DEBUG [StoreOpener-f95ae31c0549207e908fd449732ddbfb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/f95ae31c0549207e908fd449732ddbfb/family1 2023-02-08 02:56:01,482 DEBUG [StoreOpener-f95ae31c0549207e908fd449732ddbfb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/f95ae31c0549207e908fd449732ddbfb/family1 2023-02-08 02:56:01,482 INFO [StoreOpener-f95ae31c0549207e908fd449732ddbfb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f95ae31c0549207e908fd449732ddbfb columnFamilyName family1 2023-02-08 02:56:01,484 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=28 2023-02-08 02:56:01,484 INFO [StoreOpener-f95ae31c0549207e908fd449732ddbfb-1] regionserver.HStore(310): Store=f95ae31c0549207e908fd449732ddbfb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:56:01,484 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure 7b12968f53863f14d4d88e1e87d68b1d, server=jenkins-hbase12.apache.org,44577,1675824910652 in 182 msec 2023-02-08 02:56:01,484 INFO [StoreOpener-f95ae31c0549207e908fd449732ddbfb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f95ae31c0549207e908fd449732ddbfb 2023-02-08 02:56:01,485 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=7b12968f53863f14d4d88e1e87d68b1d, ASSIGN in 342 msec 2023-02-08 02:56:01,486 DEBUG [StoreOpener-f95ae31c0549207e908fd449732ddbfb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/f95ae31c0549207e908fd449732ddbfb/family2 2023-02-08 02:56:01,487 DEBUG [StoreOpener-f95ae31c0549207e908fd449732ddbfb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/f95ae31c0549207e908fd449732ddbfb/family2 2023-02-08 02:56:01,488 INFO [StoreOpener-f95ae31c0549207e908fd449732ddbfb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f95ae31c0549207e908fd449732ddbfb columnFamilyName family2 2023-02-08 02:56:01,489 INFO [StoreOpener-f95ae31c0549207e908fd449732ddbfb-1] regionserver.HStore(310): Store=f95ae31c0549207e908fd449732ddbfb/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:56:01,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/f95ae31c0549207e908fd449732ddbfb 2023-02-08 02:56:01,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/f95ae31c0549207e908fd449732ddbfb 2023-02-08 02:56:01,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 02:56:01,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for f95ae31c0549207e908fd449732ddbfb 2023-02-08 02:56:01,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/f95ae31c0549207e908fd449732ddbfb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:56:01,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened f95ae31c0549207e908fd449732ddbfb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72182278, jitterRate=0.07559975981712341}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 02:56:01,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for f95ae31c0549207e908fd449732ddbfb: Running coprocessor pre-open hook at 1675824961478Writing region info on filesystem at 1675824961478Initializing all the Stores at 1675824961479 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675824961479Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675824961479Cleaning up temporary data from old regions at 1675824961491 (+12 ms)Cleaning up detritus from prior splits at 1675824961491Running coprocessor post-open hooks at 1675824961495 (+4 ms)Region opened successfully at 1675824961495 2023-02-08 02:56:01,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb., pid=31, masterSystemTime=1675824961452 2023-02-08 02:56:01,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb. 2023-02-08 02:56:01,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb. 2023-02-08 02:56:01,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f. 2023-02-08 02:56:01,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6629972f379f1aeea9b891f6609ea66f, NAME => 'testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f.', STARTKEY => '2', ENDKEY => ''} 2023-02-08 02:56:01,498 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=f95ae31c0549207e908fd449732ddbfb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:01,498 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1675824961498"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675824961498"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675824961498"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675824961498"}]},"ts":"1675824961498"} 2023-02-08 02:56:01,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 6629972f379f1aeea9b891f6609ea66f 2023-02-08 02:56:01,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:56:01,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 6629972f379f1aeea9b891f6609ea66f 2023-02-08 02:56:01,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 6629972f379f1aeea9b891f6609ea66f 2023-02-08 02:56:01,500 INFO [StoreOpener-6629972f379f1aeea9b891f6609ea66f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6629972f379f1aeea9b891f6609ea66f 2023-02-08 02:56:01,501 DEBUG [StoreOpener-6629972f379f1aeea9b891f6609ea66f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1 2023-02-08 02:56:01,502 DEBUG [StoreOpener-6629972f379f1aeea9b891f6609ea66f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1 2023-02-08 02:56:01,502 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-02-08 02:56:01,502 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure f95ae31c0549207e908fd449732ddbfb, server=jenkins-hbase12.apache.org,44577,1675824910652 in 201 msec 2023-02-08 02:56:01,502 INFO [StoreOpener-6629972f379f1aeea9b891f6609ea66f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6629972f379f1aeea9b891f6609ea66f columnFamilyName family1 2023-02-08 02:56:01,503 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=f95ae31c0549207e908fd449732ddbfb, ASSIGN in 360 msec 2023-02-08 02:56:01,503 INFO [StoreOpener-6629972f379f1aeea9b891f6609ea66f-1] regionserver.HStore(310): Store=6629972f379f1aeea9b891f6609ea66f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:56:01,504 INFO [StoreOpener-6629972f379f1aeea9b891f6609ea66f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6629972f379f1aeea9b891f6609ea66f 2023-02-08 02:56:01,505 DEBUG [StoreOpener-6629972f379f1aeea9b891f6609ea66f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family2 2023-02-08 02:56:01,505 DEBUG [StoreOpener-6629972f379f1aeea9b891f6609ea66f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family2 2023-02-08 02:56:01,506 INFO [StoreOpener-6629972f379f1aeea9b891f6609ea66f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6629972f379f1aeea9b891f6609ea66f columnFamilyName family2 2023-02-08 02:56:01,507 INFO [StoreOpener-6629972f379f1aeea9b891f6609ea66f-1] regionserver.HStore(310): Store=6629972f379f1aeea9b891f6609ea66f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:56:01,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f 2023-02-08 02:56:01,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f 2023-02-08 02:56:01,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 02:56:01,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 6629972f379f1aeea9b891f6609ea66f 2023-02-08 02:56:01,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:56:01,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 6629972f379f1aeea9b891f6609ea66f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60447651, jitterRate=-0.09925980865955353}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 02:56:01,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 6629972f379f1aeea9b891f6609ea66f: Running coprocessor pre-open hook at 1675824961498Writing region info on filesystem at 1675824961498Initializing all the Stores at 1675824961499 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675824961499Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675824961499Cleaning up temporary data from old regions at 1675824961509 (+10 ms)Cleaning up detritus from prior splits at 1675824961509Running coprocessor post-open hooks at 1675824961513 (+4 ms)Region opened successfully at 1675824961513 2023-02-08 02:56:01,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f., pid=33, masterSystemTime=1675824961452 2023-02-08 02:56:01,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f. 2023-02-08 02:56:01,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f. 2023-02-08 02:56:01,516 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=6629972f379f1aeea9b891f6609ea66f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:01,516 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675824961516"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675824961516"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675824961516"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675824961516"}]},"ts":"1675824961516"} 2023-02-08 02:56:01,519 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=30 2023-02-08 02:56:01,519 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure 6629972f379f1aeea9b891f6609ea66f, server=jenkins-hbase12.apache.org,44577,1675824910652 in 218 msec 2023-02-08 02:56:01,521 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=27 2023-02-08 02:56:01,521 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6629972f379f1aeea9b891f6609ea66f, ASSIGN in 377 msec 2023-02-08 02:56:01,521 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 02:56:01,522 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675824961521"}]},"ts":"1675824961521"} 2023-02-08 02:56:01,523 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-02-08 02:56:01,597 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 02:56:01,601 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.3360 sec 2023-02-08 02:56:02,373 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:02,373 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:02,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-08 02:56:02,374 INFO [Listener at localhost.localdomain/44017] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-02-08 02:56:02,385 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:02,385 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:02,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:02,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:02,387 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-08 02:56:02,387 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:02,387 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-08 02:56:02,387 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-08 02:56:02,388 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:02,388 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:02,394 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:02,394 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:02,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:02,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:02,395 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:02,395 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:02,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:02,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:02,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:02,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:02,396 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:02,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:02,396 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-08 02:56:02,396 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:02,396 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-08 02:56:02,396 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb. 2023-02-08 02:56:02,396 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb. started... 2023-02-08 02:56:02,397 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f. 2023-02-08 02:56:02,397 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 02:56:02,397 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d. 2023-02-08 02:56:02,397 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d. started... 2023-02-08 02:56:02,397 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:02,397 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f95ae31c0549207e908fd449732ddbfb: 2023-02-08 02:56:02,397 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f. started... 2023-02-08 02:56:02,398 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 7b12968f53863f14d4d88e1e87d68b1d: 2023-02-08 02:56:02,398 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb. 2023-02-08 02:56:02,398 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 6629972f379f1aeea9b891f6609ea66f 2/2 column families, dataSize=48 B heapSize=632 B 2023-02-08 02:56:02,398 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d. 2023-02-08 02:56:02,398 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 02:56:02,399 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 02:56:02,814 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302085f1a4a3f58154089895604964a2f0043 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302085f1a4a3f58154089895604964a2f0043 2023-02-08 02:56:03,220 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/.tmp/family1/ef45e66cd1b14e9eb72248c808aaf665 2023-02-08 02:56:03,226 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/.tmp/family1/ef45e66cd1b14e9eb72248c808aaf665 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1/ef45e66cd1b14e9eb72248c808aaf665 2023-02-08 02:56:03,232 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1/ef45e66cd1b14e9eb72248c808aaf665, entries=1, sequenceid=5, filesize=4.9 K 2023-02-08 02:56:03,233 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 6629972f379f1aeea9b891f6609ea66f in 835ms, sequenceid=5, compaction requested=false 2023-02-08 02:56:03,233 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-02-08 02:56:03,233 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6629972f379f1aeea9b891f6609ea66f: 2023-02-08 02:56:03,234 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f. 2023-02-08 02:56:03,234 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 02:56:03,234 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 02:56:03,234 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:03,234 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-08 02:56:03,234 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-08 02:56:03,247 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:03,247 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:03,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:03,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:03,247 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,247 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:03,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:03,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:03,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:03,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:03,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-08 02:56:03,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53c1e41c[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:03,248 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-08 02:56:03,248 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,257 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,257 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-08 02:56:03,258 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-08 02:56:03,258 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:03,258 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:03,258 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:03,268 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-08 02:56:03,268 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:03,268 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-08 02:56:03,268 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:03,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:03,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:03,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:03,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:03,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:03,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:03,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:03,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:03,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:03,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-08 02:56:03,270 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-08 02:56:03,270 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:03,270 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:03,270 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,270 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:03,278 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,278 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:03,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:03,278 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:03,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:03,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:03,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:03,279 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:03,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:03,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,280 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:03,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:03,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:03,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:03,337 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:03,337 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:03,337 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:03,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:03,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:03,337 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-08 02:56:03,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:03,337 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:03,338 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-08 02:56:03,338 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:03,338 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:03,338 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:03,338 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:03,338 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:03,338 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,438 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:03,438 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:03,438 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:03,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:03,442 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:03,443 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:03,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:03,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:03,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,445 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-08 02:56:03,445 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:03,445 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-08 02:56:03,445 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-08 02:56:03,446 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,446 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,457 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:03,457 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:03,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:03,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:03,458 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:03,458 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:03,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:03,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,459 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,459 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-02-08 02:56:03,459 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:03,459 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-08 02:56:03,459 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:03,459 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-08 02:56:03,460 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb. 2023-02-08 02:56:03,460 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb. started... 2023-02-08 02:56:03,460 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f. 2023-02-08 02:56:03,460 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d. 2023-02-08 02:56:03,460 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f. started... 2023-02-08 02:56:03,460 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 02:56:03,460 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:03,460 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f95ae31c0549207e908fd449732ddbfb: 2023-02-08 02:56:03,460 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d. started... 2023-02-08 02:56:03,460 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb. 2023-02-08 02:56:03,460 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 6629972f379f1aeea9b891f6609ea66f 2/2 column families, dataSize=90 B heapSize=752 B 2023-02-08 02:56:03,460 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 02:56:03,460 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 7b12968f53863f14d4d88e1e87d68b1d: 2023-02-08 02:56:03,460 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d. 2023-02-08 02:56:03,460 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 02:56:03,874 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208cace46b245d045949ce0a324a1fe8d6d to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230208cace46b245d045949ce0a324a1fe8d6d 2023-02-08 02:56:04,281 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/.tmp/family1/3be34945eda74c7181a8b1911ca21b93 2023-02-08 02:56:04,287 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/.tmp/family1/3be34945eda74c7181a8b1911ca21b93 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1/3be34945eda74c7181a8b1911ca21b93 2023-02-08 02:56:04,296 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1/3be34945eda74c7181a8b1911ca21b93, entries=2, sequenceid=9, filesize=5.0 K 2023-02-08 02:56:04,296 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 6629972f379f1aeea9b891f6609ea66f in 836ms, sequenceid=9, compaction requested=false 2023-02-08 02:56:04,297 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6629972f379f1aeea9b891f6609ea66f: 2023-02-08 02:56:04,297 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f. 2023-02-08 02:56:04,297 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 02:56:04,297 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 02:56:04,297 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:04,297 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-08 02:56:04,297 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-08 02:56:04,310 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:04,310 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:04,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:04,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:04,310 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:04,310 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:04,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:04,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:04,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:04,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-08 02:56:04,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27b3621d[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:04,312 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-08 02:56:04,312 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,320 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,321 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:04,321 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-08 02:56:04,321 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-08 02:56:04,321 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:04,321 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:04,331 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-08 02:56:04,331 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:04,331 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-08 02:56:04,331 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:04,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:04,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:04,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:04,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:04,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:04,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:04,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-08 02:56:04,334 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-08 02:56:04,334 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:04,334 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:04,334 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,334 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:04,341 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,341 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,341 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:04,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:04,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:04,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:04,342 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:04,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:04,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:04,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:04,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:04,343 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:04,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:04,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:04,352 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:04,352 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,352 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-08 02:56:04,352 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:04,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-08 02:56:04,352 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:04,352 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:04,352 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:04,352 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:04,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:04,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:04,352 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,352 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,353 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:04,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:04,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:04,353 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:04,453 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:04,453 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:04,453 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:04,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:04,460 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-02-08 02:56:04,464 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-08 02:56:04,464 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-08 02:56:04,465 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:56:04,465 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675825564465 2023-02-08 02:56:04,466 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 02:56:04,466 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-02-08 02:56:04,466 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-08 02:56:04,467 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] zookeeper.ReadOnlyZKClient(139): Connect 0x6b1b55ce to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:56:04,479 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3638c907, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:56:04,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230208 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-08 02:56:05,323 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208fbdfed2c5b034723b269b90df8a3fc73 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230208fbdfed2c5b034723b269b90df8a3fc73 2023-02-08 02:56:05,324 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230208 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-08 02:56:05,338 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 02:56:05,339 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:56772, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 02:56:05,346 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:05,346 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:05,346 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 02:56:05,348 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:36290, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 02:56:05,358 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230208/family1/4b49a11901d7406aa2ddd28584e3867d first=Optional[k0] last=Optional[k1] 2023-02-08 02:56:05,359 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230208/family1/4b49a11901d7406aa2ddd28584e3867d}] 2023-02-08 02:56:05,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230208/family1/4b49a11901d7406aa2ddd28584e3867d for inclusion in 6629972f379f1aeea9b891f6609ea66f/family1 2023-02-08 02:56:05,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-02-08 02:56:05,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-08 02:56:05,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for 6629972f379f1aeea9b891f6609ea66f: 2023-02-08 02:56:05,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230208/family1/4b49a11901d7406aa2ddd28584e3867d to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testScannerOnBulkLoadRefHFiles__psplhtelia7ov621s4tbqcs5tplbo8nmdcp342uu3esapm7r23p985b0n42rhu15/family1/4b49a11901d7406aa2ddd28584e3867d 2023-02-08 02:56:05,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testScannerOnBulkLoadRefHFiles__psplhtelia7ov621s4tbqcs5tplbo8nmdcp342uu3esapm7r23p985b0n42rhu15/family1/4b49a11901d7406aa2ddd28584e3867d as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1/3eaf3b77966a42efa8438edd9a374209_SeqId_12_ 2023-02-08 02:56:05,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testScannerOnBulkLoadRefHFiles__psplhtelia7ov621s4tbqcs5tplbo8nmdcp342uu3esapm7r23p985b0n42rhu15/family1/4b49a11901d7406aa2ddd28584e3867d into 6629972f379f1aeea9b891f6609ea66f/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1/3eaf3b77966a42efa8438edd9a374209_SeqId_12_ - updating store file list. 2023-02-08 02:56:05,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1/3eaf3b77966a42efa8438edd9a374209_SeqId_12_ into 6629972f379f1aeea9b891f6609ea66f/family1 2023-02-08 02:56:05,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testScannerOnBulkLoadRefHFiles__psplhtelia7ov621s4tbqcs5tplbo8nmdcp342uu3esapm7r23p985b0n42rhu15/family1/4b49a11901d7406aa2ddd28584e3867d into 6629972f379f1aeea9b891f6609ea66f/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1/3eaf3b77966a42efa8438edd9a374209_SeqId_12_) 2023-02-08 02:56:05,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testScannerOnBulkLoadRefHFiles__psplhtelia7ov621s4tbqcs5tplbo8nmdcp342uu3esapm7r23p985b0n42rhu15/family1/4b49a11901d7406aa2ddd28584e3867d 2023-02-08 02:56:05,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-08 02:56:05,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-08 02:56:05,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(1912): 6629972f379f1aeea9b891f6609ea66f/family1 is initiating minor compaction (all files) 2023-02-08 02:56:05,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@369c94d7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:56:05,377 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 6629972f379f1aeea9b891f6609ea66f/family1 in testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f. 2023-02-08 02:56:05,377 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1/ef45e66cd1b14e9eb72248c808aaf665, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1/3be34945eda74c7181a8b1911ca21b93, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1/3eaf3b77966a42efa8438edd9a374209_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/.tmp, totalSize=15.1 K 2023-02-08 02:56:05,377 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting ef45e66cd1b14e9eb72248c808aaf665, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675824962375 2023-02-08 02:56:05,378 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 3be34945eda74c7181a8b1911ca21b93, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675824962375 2023-02-08 02:56:05,379 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 3eaf3b77966a42efa8438edd9a374209_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675824962375 2023-02-08 02:56:05,379 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230208 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-08 02:56:05,379 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:56:05,381 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302085f1a4a3f58154089895604964a2f0043 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302085f1a4a3f58154089895604964a2f0043 2023-02-08 02:56:05,382 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230208cace46b245d045949ce0a324a1fe8d6d to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230208cace46b245d045949ce0a324a1fe8d6d 2023-02-08 02:56:05,382 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-02-08 02:56:05,382 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230208' 2023-02-08 02:56:05,383 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230208 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-08 02:56:05,383 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-08 02:56:05,383 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:56:05,384 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-08 02:56:05,385 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 921 msec 2023-02-08 02:56:05,390 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6629972f379f1aeea9b891f6609ea66f#family1#compaction#38 average throughput is 0.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:56:05,418 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=245 (was 249), OpenFileDescriptor=587 (was 587), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=210 (was 229), ProcessCount=174 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=3820 (was 3950) 2023-02-08 02:56:05,432 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=245, OpenFileDescriptor=587, MaxFileDescriptor=60000, SystemLoadAverage=210, ProcessCount=174, AvailableMemoryMB=3820 2023-02-08 02:56:05,432 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:05,433 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:05,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-08 02:56:05,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:05,437 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 02:56:05,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-02-08 02:56:05,437 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:05,437 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:05,437 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 02:56:05,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-08 02:56:05,439 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac 2023-02-08 02:56:05,440 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac empty. 2023-02-08 02:56:05,440 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac 2023-02-08 02:56:05,440 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-02-08 02:56:05,539 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:05,539 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:05,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-08 02:56:05,740 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:05,741 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:05,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-08 02:56:05,851 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-08 02:56:05,853 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => cbbfde4ca627bec304375d93283fccac, NAME => 'testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp 2023-02-08 02:56:06,043 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:06,043 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:06,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-08 02:56:06,263 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:56:06,263 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing cbbfde4ca627bec304375d93283fccac, disabling compactions & flushes 2023-02-08 02:56:06,264 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:06,264 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:06,264 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. after waiting 0 ms 2023-02-08 02:56:06,264 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:06,264 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:06,264 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for cbbfde4ca627bec304375d93283fccac: Waiting for close lock at 1675824966263Disabling compacts and flushes for region at 1675824966263Disabling writes for close at 1675824966264 (+1 ms)Writing region close event to WAL at 1675824966264Closed at 1675824966264 2023-02-08 02:56:06,267 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 02:56:06,268 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675824966268"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675824966268"}]},"ts":"1675824966268"} 2023-02-08 02:56:06,270 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 02:56:06,272 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 02:56:06,272 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675824966272"}]},"ts":"1675824966272"} 2023-02-08 02:56:06,274 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-08 02:56:06,289 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=cbbfde4ca627bec304375d93283fccac, ASSIGN}] 2023-02-08 02:56:06,291 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=cbbfde4ca627bec304375d93283fccac, ASSIGN 2023-02-08 02:56:06,292 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=cbbfde4ca627bec304375d93283fccac, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=false 2023-02-08 02:56:06,443 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=cbbfde4ca627bec304375d93283fccac, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:06,443 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675824966443"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675824966443"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675824966443"}]},"ts":"1675824966443"} 2023-02-08 02:56:06,445 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure cbbfde4ca627bec304375d93283fccac, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:56:06,545 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:06,545 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:06,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-08 02:56:06,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:06,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cbbfde4ca627bec304375d93283fccac, NAME => 'testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac.', STARTKEY => '', ENDKEY => ''} 2023-02-08 02:56:06,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy cbbfde4ca627bec304375d93283fccac 2023-02-08 02:56:06,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:56:06,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for cbbfde4ca627bec304375d93283fccac 2023-02-08 02:56:06,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for cbbfde4ca627bec304375d93283fccac 2023-02-08 02:56:06,602 INFO [StoreOpener-cbbfde4ca627bec304375d93283fccac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cbbfde4ca627bec304375d93283fccac 2023-02-08 02:56:06,605 DEBUG [StoreOpener-cbbfde4ca627bec304375d93283fccac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1 2023-02-08 02:56:06,605 DEBUG [StoreOpener-cbbfde4ca627bec304375d93283fccac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1 2023-02-08 02:56:06,605 INFO [StoreOpener-cbbfde4ca627bec304375d93283fccac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cbbfde4ca627bec304375d93283fccac columnFamilyName family1 2023-02-08 02:56:06,608 INFO [StoreOpener-cbbfde4ca627bec304375d93283fccac-1] regionserver.HStore(310): Store=cbbfde4ca627bec304375d93283fccac/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:56:06,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac 2023-02-08 02:56:06,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac 2023-02-08 02:56:06,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for cbbfde4ca627bec304375d93283fccac 2023-02-08 02:56:06,618 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/.tmp/family1/e50c79fdc4674b52b8e208f4acd88214 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1/e50c79fdc4674b52b8e208f4acd88214 2023-02-08 02:56:06,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:56:06,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened cbbfde4ca627bec304375d93283fccac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74140651, jitterRate=0.10478179156780243}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 02:56:06,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for cbbfde4ca627bec304375d93283fccac: Running coprocessor pre-open hook at 1675824966601Writing region info on filesystem at 1675824966601Initializing all the Stores at 1675824966602 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675824966602Cleaning up temporary data from old regions at 1675824966612 (+10 ms)Cleaning up detritus from prior splits at 1675824966612Running coprocessor post-open hooks at 1675824966619 (+7 ms)Region opened successfully at 1675824966619 2023-02-08 02:56:06,620 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac., pid=37, masterSystemTime=1675824966596 2023-02-08 02:56:06,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:06,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:06,623 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=cbbfde4ca627bec304375d93283fccac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:06,623 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675824966623"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675824966623"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675824966623"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675824966623"}]},"ts":"1675824966623"} 2023-02-08 02:56:06,625 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 6629972f379f1aeea9b891f6609ea66f/family1 of 6629972f379f1aeea9b891f6609ea66f into e50c79fdc4674b52b8e208f4acd88214(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:56:06,625 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 6629972f379f1aeea9b891f6609ea66f: 2023-02-08 02:56:06,625 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1675824965376; duration=1sec 2023-02-08 02:56:06,625 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:56:06,626 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-02-08 02:56:06,626 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure cbbfde4ca627bec304375d93283fccac, server=jenkins-hbase12.apache.org,44577,1675824910652 in 179 msec 2023-02-08 02:56:06,627 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-02-08 02:56:06,627 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=cbbfde4ca627bec304375d93283fccac, ASSIGN in 337 msec 2023-02-08 02:56:06,628 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 02:56:06,628 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675824966628"}]},"ts":"1675824966628"} 2023-02-08 02:56:06,629 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-08 02:56:06,691 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 02:56:06,694 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.2570 sec 2023-02-08 02:56:06,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1/ef45e66cd1b14e9eb72248c808aaf665, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1/3be34945eda74c7181a8b1911ca21b93, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1/3eaf3b77966a42efa8438edd9a374209_SeqId_12_] to archive 2023-02-08 02:56:06,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:56:06,727 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1/ef45e66cd1b14e9eb72248c808aaf665 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1/ef45e66cd1b14e9eb72248c808aaf665 2023-02-08 02:56:06,730 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1/3be34945eda74c7181a8b1911ca21b93 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1/3be34945eda74c7181a8b1911ca21b93 2023-02-08 02:56:06,732 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1/3eaf3b77966a42efa8438edd9a374209_SeqId_12_ to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/family1/3eaf3b77966a42efa8438edd9a374209_SeqId_12_ 2023-02-08 02:56:06,990 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 02:56:07,231 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 02:56:07,547 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:07,547 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:07,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-08 02:56:07,549 INFO [Listener at localhost.localdomain/44017] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-02-08 02:56:07,577 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:07,577 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:07,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:07,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:07,580 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 02:56:07,580 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:07,580 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 02:56:07,580 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 02:56:07,580 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:07,580 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:07,698 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:07,698 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:07,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:07,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:07,699 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:07,699 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:07,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:07,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:07,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:07,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:07,700 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:07,701 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:07,701 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 02:56:07,701 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:07,701 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 02:56:07,702 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:07,702 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:07,702 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:07,702 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. started... 2023-02-08 02:56:07,703 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cbbfde4ca627bec304375d93283fccac 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-08 02:56:08,136 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113005babe92a88a43e29cce4cfe7d584e9a to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113005babe92a88a43e29cce4cfe7d584e9a 2023-02-08 02:56:08,541 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp/family1/97e0315cf84c49d69397b14c6a9b6207 2023-02-08 02:56:08,547 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp/family1/97e0315cf84c49d69397b14c6a9b6207 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/97e0315cf84c49d69397b14c6a9b6207 2023-02-08 02:56:08,552 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/97e0315cf84c49d69397b14c6a9b6207, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-08 02:56:08,553 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for cbbfde4ca627bec304375d93283fccac in 850ms, sequenceid=5, compaction requested=false 2023-02-08 02:56:08,553 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cbbfde4ca627bec304375d93283fccac: 2023-02-08 02:56:08,553 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:08,553 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:08,553 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:08,553 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:08,553 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 02:56:08,553 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-08 02:56:08,573 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:08,573 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:08,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:08,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:08,573 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,573 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:08,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:08,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:08,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:08,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:08,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 02:56:08,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44eee448[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:08,575 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 02:56:08,575 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,583 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,583 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 02:56:08,583 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-08 02:56:08,584 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:08,584 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:08,584 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:08,594 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 02:56:08,594 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:08,594 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-08 02:56:08,594 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:08,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:08,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:08,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:08,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:08,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:08,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:08,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:08,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:08,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:08,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:56:08,601 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-08 02:56:08,601 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:08,601 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:08,601 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,601 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:08,615 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,615 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,615 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:08,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:08,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:08,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:08,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:08,616 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:08,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:08,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:08,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,619 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:08,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:08,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:08,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:08,636 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:08,636 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:08,636 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:08,636 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,636 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:08,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:08,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:08,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 02:56:08,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:08,636 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 02:56:08,637 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:08,638 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:08,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:08,637 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:08,638 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:08,638 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,638 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,738 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:08,739 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:08,739 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:08,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:08,749 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:08,750 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:08,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:08,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:08,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,753 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 02:56:08,753 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:08,754 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 02:56:08,754 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 02:56:08,754 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,755 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,762 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:08,762 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:08,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:08,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:08,763 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:08,763 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:08,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:08,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,765 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,766 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 02:56:08,766 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:08,766 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 02:56:08,766 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:08,766 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 02:56:08,766 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:08,766 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:08,767 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:08,767 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. started... 2023-02-08 02:56:08,767 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cbbfde4ca627bec304375d93283fccac 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-08 02:56:09,186 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284f1d0e46d8174884817dcbf93e241483 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511284f1d0e46d8174884817dcbf93e241483 2023-02-08 02:56:09,593 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp/family1/9cbefeac1c6e485d8ca97cd5642ab668 2023-02-08 02:56:09,599 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp/family1/9cbefeac1c6e485d8ca97cd5642ab668 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/9cbefeac1c6e485d8ca97cd5642ab668 2023-02-08 02:56:09,604 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/9cbefeac1c6e485d8ca97cd5642ab668, entries=1, sequenceid=9, filesize=5.0 K 2023-02-08 02:56:09,604 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for cbbfde4ca627bec304375d93283fccac in 837ms, sequenceid=9, compaction requested=false 2023-02-08 02:56:09,605 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cbbfde4ca627bec304375d93283fccac: 2023-02-08 02:56:09,605 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:09,605 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:09,605 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:09,605 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:09,605 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 02:56:09,605 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-08 02:56:09,657 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:09,657 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:09,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:09,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:09,658 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:09,658 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:09,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:09,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:09,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:09,662 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 02:56:09,662 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74da5815[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:09,662 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 02:56:09,662 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,710 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,711 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 02:56:09,711 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-08 02:56:09,711 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:09,711 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:09,711 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:09,731 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:09,731 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 02:56:09,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:09,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:09,731 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:09,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:09,731 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-08 02:56:09,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:09,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:09,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:09,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:09,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:09,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:09,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:56:09,739 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-08 02:56:09,739 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:09,739 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:09,739 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,740 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:09,752 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,752 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,752 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:09,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:09,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:09,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:09,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:09,754 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:09,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:09,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:09,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,758 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:09,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:09,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:09,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:09,773 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:09,773 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:09,773 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,773 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,773 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:09,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:09,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:09,773 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:09,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 02:56:09,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:09,773 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:09,774 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 02:56:09,774 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:09,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:09,774 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,774 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,774 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:09,775 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:09,875 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:09,875 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:09,875 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:09,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:09,882 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:09,882 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:09,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:09,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:09,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,885 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 02:56:09,885 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:09,885 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 02:56:09,885 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 02:56:09,885 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,885 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,898 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:09,898 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:09,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:09,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:09,898 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:09,898 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:09,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:09,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,899 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,899 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 02:56:09,900 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:09,900 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 02:56:09,900 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:09,900 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 02:56:09,900 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:09,900 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:09,900 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:09,900 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. started... 2023-02-08 02:56:09,900 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cbbfde4ca627bec304375d93283fccac 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:10,318 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512015a1ccd71ecd74d2d8d3b7fd232df5a53 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512015a1ccd71ecd74d2d8d3b7fd232df5a53 2023-02-08 02:56:10,724 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp/family1/ab316266d99e4945bd9a0222acf7f908 2023-02-08 02:56:10,732 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp/family1/ab316266d99e4945bd9a0222acf7f908 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/ab316266d99e4945bd9a0222acf7f908 2023-02-08 02:56:10,738 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/ab316266d99e4945bd9a0222acf7f908, entries=1, sequenceid=13, filesize=4.9 K 2023-02-08 02:56:10,739 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cbbfde4ca627bec304375d93283fccac in 839ms, sequenceid=13, compaction requested=true 2023-02-08 02:56:10,739 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cbbfde4ca627bec304375d93283fccac: 2023-02-08 02:56:10,739 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:10,739 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:10,739 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:10,739 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:10,739 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 02:56:10,739 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-08 02:56:10,751 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:10,751 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:10,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:10,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:10,752 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,752 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:10,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:10,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:10,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:10,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:10,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 02:56:10,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28e7a396[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:10,754 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 02:56:10,754 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,773 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,773 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 02:56:10,773 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-08 02:56:10,773 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:10,773 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:10,773 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:10,783 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 02:56:10,783 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:10,783 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:10,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:10,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:10,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:10,783 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-08 02:56:10,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:10,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:10,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:10,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:10,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:10,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:10,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:56:10,786 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-08 02:56:10,786 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:10,786 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:10,786 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,786 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:10,794 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,794 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:10,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:10,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,794 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:10,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:10,794 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:10,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:10,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:10,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:10,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,796 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:10,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:10,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:10,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:10,804 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:10,804 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:10,804 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:10,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 02:56:10,804 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:10,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:10,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 02:56:10,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:10,804 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:10,804 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,804 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:10,805 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:10,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:10,805 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,805 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:10,805 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,805 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:10,905 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:10,905 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:10,905 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:10,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:10,911 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:10,912 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:10,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:10,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:10,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,915 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 02:56:10,915 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:10,915 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 02:56:10,915 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 02:56:10,915 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,915 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,930 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:10,930 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:10,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:10,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:10,931 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:10,931 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:10,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:10,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,931 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,932 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 02:56:10,932 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:10,932 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 02:56:10,932 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:10,932 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 02:56:10,932 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:10,932 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:10,932 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:10,932 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. started... 2023-02-08 02:56:10,932 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cbbfde4ca627bec304375d93283fccac 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:11,349 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512054e1d4bd3ed0c4c22b809fed39861f37b to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512054e1d4bd3ed0c4c22b809fed39861f37b 2023-02-08 02:56:11,758 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp/family1/251351f03e4a40969a4b6b8bcbea500b 2023-02-08 02:56:11,765 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp/family1/251351f03e4a40969a4b6b8bcbea500b as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/251351f03e4a40969a4b6b8bcbea500b 2023-02-08 02:56:11,774 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/251351f03e4a40969a4b6b8bcbea500b, entries=1, sequenceid=17, filesize=4.9 K 2023-02-08 02:56:11,775 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cbbfde4ca627bec304375d93283fccac in 843ms, sequenceid=17, compaction requested=true 2023-02-08 02:56:11,775 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cbbfde4ca627bec304375d93283fccac: 2023-02-08 02:56:11,775 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:11,776 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:11,776 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:11,776 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:11,776 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 02:56:11,776 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-08 02:56:11,847 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:11,847 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:11,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:11,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:11,848 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,848 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:11,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:11,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:11,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:11,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:11,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 02:56:11,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14788f1d[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:11,852 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 02:56:11,852 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,867 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,868 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 02:56:11,868 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-08 02:56:11,868 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:11,868 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:11,868 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:11,878 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 02:56:11,878 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:11,878 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:11,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:11,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:11,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:11,878 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-08 02:56:11,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:11,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:11,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:11,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:11,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:11,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:11,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:56:11,883 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-08 02:56:11,883 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:11,883 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:11,883 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,883 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:11,888 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,888 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,888 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:11,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:11,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:11,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:11,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:11,890 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:11,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:11,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:11,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,891 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:11,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:11,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:11,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:11,899 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:11,899 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:11,899 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,899 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,899 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:11,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:11,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:11,899 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:11,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 02:56:11,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:11,899 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:11,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 02:56:11,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:11,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:11,900 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,900 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:11,900 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:11,901 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:11,901 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,001 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:12,001 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:12,001 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:12,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:12,013 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:12,013 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:12,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:12,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:12,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,016 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 02:56:12,016 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:12,016 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 02:56:12,016 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 02:56:12,017 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,017 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,056 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:12,056 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:12,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:12,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:12,057 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:12,057 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:12,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,057 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:12,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,058 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,058 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 02:56:12,058 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,058 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 02:56:12,058 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:12,058 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 02:56:12,058 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:12,059 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:12,059 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:12,059 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. started... 2023-02-08 02:56:12,059 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cbbfde4ca627bec304375d93283fccac 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:12,104 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 02:56:12,473 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228c8f1fc1e826d494d9f9e2a913019fd47 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228c8f1fc1e826d494d9f9e2a913019fd47 2023-02-08 02:56:12,881 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp/family1/0c22ef7951ed44eda5e4e5f237d64de3 2023-02-08 02:56:12,887 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp/family1/0c22ef7951ed44eda5e4e5f237d64de3 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/0c22ef7951ed44eda5e4e5f237d64de3 2023-02-08 02:56:12,893 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/0c22ef7951ed44eda5e4e5f237d64de3, entries=1, sequenceid=21, filesize=4.9 K 2023-02-08 02:56:12,894 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cbbfde4ca627bec304375d93283fccac in 835ms, sequenceid=21, compaction requested=true 2023-02-08 02:56:12,894 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cbbfde4ca627bec304375d93283fccac: 2023-02-08 02:56:12,894 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:12,895 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:12,895 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:12,895 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:12,895 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 02:56:12,895 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-08 02:56:12,930 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:12,930 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:12,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:12,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:12,931 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,931 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:12,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:12,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:12,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:12,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:12,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 02:56:12,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2707e57e[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:12,933 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 02:56:12,933 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,941 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,941 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 02:56:12,941 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-08 02:56:12,941 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:12,941 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:12,941 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:12,951 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 02:56:12,951 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:12,952 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-08 02:56:12,951 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:12,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:12,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:12,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:12,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:12,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:12,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:12,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:12,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:12,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:12,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:56:12,959 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-08 02:56:12,959 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:12,959 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:12,959 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,959 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:12,973 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,973 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,973 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:12,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:12,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:12,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:12,974 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:12,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:12,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:12,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:12,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,978 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:12,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:12,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:12,992 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:12,992 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,992 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,992 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:12,992 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:12,992 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:12,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:12,992 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:12,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:12,992 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 02:56:12,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 02:56:12,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:12,992 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,993 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,993 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:12,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:12,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:12,993 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:12,993 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:13,094 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:13,094 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:13,094 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:13,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:13,103 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:13,104 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:13,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:13,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:13,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:13,108 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 02:56:13,108 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:13,108 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 02:56:13,108 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 02:56:13,109 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:13,109 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:13,120 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:13,120 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:13,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:13,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:13,120 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:13,120 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:13,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:13,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:13,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:13,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:13,122 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:13,122 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 02:56:13,122 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:13,122 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 02:56:13,122 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:13,122 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 02:56:13,122 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:13,122 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:13,122 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:13,122 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. started... 2023-02-08 02:56:13,122 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cbbfde4ca627bec304375d93283fccac 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:13,540 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231f7aac76b8caa48568de3d07eddc120c2 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231f7aac76b8caa48568de3d07eddc120c2 2023-02-08 02:56:13,947 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp/family1/af4d5071f6fb410f8acbe12a340f6303 2023-02-08 02:56:13,954 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp/family1/af4d5071f6fb410f8acbe12a340f6303 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/af4d5071f6fb410f8acbe12a340f6303 2023-02-08 02:56:13,959 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/af4d5071f6fb410f8acbe12a340f6303, entries=1, sequenceid=25, filesize=4.9 K 2023-02-08 02:56:13,960 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cbbfde4ca627bec304375d93283fccac in 838ms, sequenceid=25, compaction requested=true 2023-02-08 02:56:13,960 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cbbfde4ca627bec304375d93283fccac: 2023-02-08 02:56:13,960 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:13,960 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:13,960 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:13,960 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:13,960 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 02:56:13,960 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-08 02:56:13,972 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:13,972 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:13,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:13,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:13,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:13,973 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:13,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:13,973 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:13,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:13,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:13,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:13,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:13,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 02:56:13,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13b1b7b[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:13,976 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 02:56:13,976 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:13,983 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:13,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:13,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:13,983 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 02:56:13,983 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-08 02:56:13,983 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:13,984 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:13,984 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:13,994 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:13,994 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 02:56:13,994 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:13,994 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-08 02:56:13,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:13,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:13,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:13,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:13,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:13,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:13,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:13,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:13,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:14,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:14,002 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:56:14,002 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-08 02:56:14,002 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:14,002 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:14,002 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,002 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:14,014 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,014 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,015 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:14,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:14,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:14,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:14,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:14,016 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:14,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:14,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:14,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,019 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:14,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:14,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:14,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:14,034 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:14,034 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:14,034 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:14,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 02:56:14,035 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:14,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:14,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 02:56:14,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:14,035 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:14,035 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,036 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:14,036 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,036 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:14,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:14,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:14,037 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:14,036 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,037 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,137 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:14,138 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:14,138 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:14,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:14,145 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:14,145 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:14,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:14,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:14,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,149 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 02:56:14,149 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:14,149 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 02:56:14,150 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 02:56:14,150 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,150 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,162 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:14,162 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:14,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:14,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:14,163 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:14,163 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:14,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,164 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:14,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,165 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,165 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 02:56:14,166 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:14,166 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 02:56:14,166 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:14,166 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 02:56:14,166 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:14,166 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:14,166 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:14,167 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. started... 2023-02-08 02:56:14,167 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cbbfde4ca627bec304375d93283fccac 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:14,591 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601011ce6a2beb64b4c189c476926b650699e to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601011ce6a2beb64b4c189c476926b650699e 2023-02-08 02:56:14,999 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp/family1/fe54659b68e94615a02270c5e059fbec 2023-02-08 02:56:15,009 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp/family1/fe54659b68e94615a02270c5e059fbec as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/fe54659b68e94615a02270c5e059fbec 2023-02-08 02:56:15,015 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/fe54659b68e94615a02270c5e059fbec, entries=1, sequenceid=29, filesize=4.9 K 2023-02-08 02:56:15,015 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cbbfde4ca627bec304375d93283fccac in 848ms, sequenceid=29, compaction requested=true 2023-02-08 02:56:15,016 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cbbfde4ca627bec304375d93283fccac: 2023-02-08 02:56:15,016 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:15,016 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:15,016 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:15,016 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:15,016 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 02:56:15,016 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-08 02:56:15,056 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:15,056 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:15,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:15,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:15,057 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,057 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:15,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:15,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:15,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:15,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:15,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 02:56:15,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14d5e3d9[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:15,058 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 02:56:15,058 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,067 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,067 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 02:56:15,067 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-08 02:56:15,067 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:15,067 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:15,067 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:15,078 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 02:56:15,078 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:15,078 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-08 02:56:15,078 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:15,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:15,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:15,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:15,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:15,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:15,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:15,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:15,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:15,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:15,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:56:15,082 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-08 02:56:15,082 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:15,082 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:15,082 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,082 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:15,088 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,088 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:15,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,088 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:15,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:15,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:15,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:15,089 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:15,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:15,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:15,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,091 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:15,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:15,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:15,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:15,134 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:15,135 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,135 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,135 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:15,135 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,135 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:15,135 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:15,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:15,135 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 02:56:15,135 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,135 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 02:56:15,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:15,135 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:15,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:15,136 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:15,136 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:15,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:15,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:15,237 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:15,237 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:15,237 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:15,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:15,247 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:15,247 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:15,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:15,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:15,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,252 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 02:56:15,252 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:15,252 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 02:56:15,252 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 02:56:15,253 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,253 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,267 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:15,267 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:15,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:15,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:15,268 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:15,268 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:15,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:15,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,270 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,271 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 02:56:15,271 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:15,271 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 02:56:15,271 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:15,271 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 02:56:15,271 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:15,271 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:15,271 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:15,271 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. started... 2023-02-08 02:56:15,272 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cbbfde4ca627bec304375d93283fccac 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:15,690 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010367d6b332a04241e3834dcdfa8001beef to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010367d6b332a04241e3834dcdfa8001beef 2023-02-08 02:56:16,099 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp/family1/34cacd487f8c4b4abf12ebd33f149eca 2023-02-08 02:56:16,106 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp/family1/34cacd487f8c4b4abf12ebd33f149eca as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/34cacd487f8c4b4abf12ebd33f149eca 2023-02-08 02:56:16,112 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/34cacd487f8c4b4abf12ebd33f149eca, entries=1, sequenceid=33, filesize=4.9 K 2023-02-08 02:56:16,113 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cbbfde4ca627bec304375d93283fccac in 841ms, sequenceid=33, compaction requested=true 2023-02-08 02:56:16,113 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cbbfde4ca627bec304375d93283fccac: 2023-02-08 02:56:16,113 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:16,113 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:16,113 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:16,113 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:16,113 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 02:56:16,113 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-08 02:56:16,172 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,172 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:16,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:16,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:16,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:16,173 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,173 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:16,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:16,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:16,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:16,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:16,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 02:56:16,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44059639[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:16,175 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 02:56:16,175 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,261 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,261 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 02:56:16,261 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-08 02:56:16,261 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:16,261 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:16,262 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:16,324 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 02:56:16,324 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:16,324 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:16,324 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-08 02:56:16,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:16,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:16,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:16,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:16,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:16,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:16,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:16,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:16,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:16,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:56:16,329 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-08 02:56:16,329 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:16,329 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:16,329 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,329 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:16,435 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,435 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:16,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,435 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:16,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:16,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:16,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:16,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:16,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,436 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:16,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:16,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,437 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:16,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:16,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:16,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:16,636 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:16,636 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:16,636 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:16,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:16,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 02:56:16,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:16,636 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,637 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:16,636 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:16,636 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:16,637 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:16,637 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:16,637 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,638 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,638 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:16,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:16,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 02:56:16,737 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:16,738 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:16,738 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:16,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:16,741 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:16,741 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:16,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:16,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:16,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,743 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 02:56:16,743 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:16,743 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 02:56:16,743 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 02:56:16,744 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,744 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,751 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:16,751 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:16,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:16,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:16,752 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:16,752 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:16,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:16,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,752 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,753 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 02:56:16,753 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:16,753 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 02:56:16,753 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:16,753 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 02:56:16,753 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:16,753 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:16,753 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:16,753 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. started... 2023-02-08 02:56:16,753 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cbbfde4ca627bec304375d93283fccac 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:17,166 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907c450a307df8e4bff915ba442b3f407e7 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907c450a307df8e4bff915ba442b3f407e7 2023-02-08 02:56:17,573 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp/family1/3f9aa3cb12a5480485d79516fd9d62df 2023-02-08 02:56:17,579 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp/family1/3f9aa3cb12a5480485d79516fd9d62df as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/3f9aa3cb12a5480485d79516fd9d62df 2023-02-08 02:56:17,585 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/3f9aa3cb12a5480485d79516fd9d62df, entries=1, sequenceid=37, filesize=4.9 K 2023-02-08 02:56:17,586 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cbbfde4ca627bec304375d93283fccac in 833ms, sequenceid=37, compaction requested=true 2023-02-08 02:56:17,587 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cbbfde4ca627bec304375d93283fccac: 2023-02-08 02:56:17,587 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:17,587 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:17,587 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:17,587 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,587 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 02:56:17,587 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-08 02:56:17,678 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,678 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:17,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:17,679 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,679 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:17,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:17,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:17,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:17,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 02:56:17,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5cb1a7d2[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:17,681 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 02:56:17,681 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,699 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,699 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 02:56:17,699 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-08 02:56:17,699 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:17,699 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,699 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:17,709 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,709 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 02:56:17,709 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:17,709 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-08 02:56:17,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:17,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:17,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:56:17,713 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-08 02:56:17,713 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:17,714 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:17,714 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,714 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:17,719 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,719 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,719 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:17,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:17,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:17,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:17,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:17,720 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:17,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:17,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,721 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:17,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,730 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,730 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,730 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:17,730 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:17,730 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,730 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:17,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:17,730 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,730 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 02:56:17,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:17,730 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:17,730 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,730 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 02:56:17,731 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:17,731 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:17,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:17,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:17,831 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:17,831 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:17,831 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:17,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:17,837 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:17,837 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:17,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:17,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:17,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,841 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 02:56:17,841 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:17,841 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 02:56:17,841 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 02:56:17,842 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,842 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,855 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:17,855 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:17,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:17,856 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,856 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:17,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:17,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,858 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,859 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 02:56:17,859 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,859 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 02:56:17,859 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:17,859 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 02:56:17,859 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:17,860 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:17,860 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:17,860 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. started... 2023-02-08 02:56:17,860 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cbbfde4ca627bec304375d93283fccac 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:17,880 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120b08530daa3084722aeaf769410862e07 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120b08530daa3084722aeaf769410862e07 2023-02-08 02:56:17,887 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp/family1/6c2ca342c17c4b2caba620eb7c045ec2 2023-02-08 02:56:17,895 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp/family1/6c2ca342c17c4b2caba620eb7c045ec2 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/6c2ca342c17c4b2caba620eb7c045ec2 2023-02-08 02:56:17,901 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/6c2ca342c17c4b2caba620eb7c045ec2, entries=1, sequenceid=41, filesize=4.9 K 2023-02-08 02:56:17,911 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cbbfde4ca627bec304375d93283fccac in 51ms, sequenceid=41, compaction requested=true 2023-02-08 02:56:17,911 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cbbfde4ca627bec304375d93283fccac: 2023-02-08 02:56:17,911 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:17,911 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:17,911 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:17,911 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,911 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 02:56:17,911 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-08 02:56:17,919 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,919 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:17,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:17,920 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,920 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:17,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:17,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:17,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:17,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 02:56:17,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5089ffc[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:17,921 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 02:56:17,922 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,930 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,930 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 02:56:17,930 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-08 02:56:17,930 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,930 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:17,930 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:17,940 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 02:56:17,940 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,940 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:17,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:17,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:17,941 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-08 02:56:17,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:17,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:17,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:17,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:17,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:56:17,943 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-08 02:56:17,943 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:17,943 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:17,943 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,943 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:17,980 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,980 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,980 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:17,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:17,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:17,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:17,980 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:17,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:17,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:17,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,981 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:17,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:17,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:17,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:18,004 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:18,004 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:18,004 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:18,004 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 02:56:18,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 02:56:18,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:18,004 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:18,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:18,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:18,004 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:18,004 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:18,004 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:18,004 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:18,004 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:18,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:18,004 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:18,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:18,004 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:18,004 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:18,105 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:18,105 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:18,105 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:18,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:18,107 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-02-08 02:56:18,109 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 02:56:18,110 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 02:56:18,111 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:56:18,111 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675825578111 2023-02-08 02:56:18,112 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 02:56:18,113 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-08 02:56:18,114 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 02:56:18,114 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] zookeeper.ReadOnlyZKClient(139): Connect 0x304f0918 to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:56:18,153 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40cf9ee7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:56:18,153 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 02:56:18,655 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032dbdb2497a0f4daebef2533d322697e6 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601032dbdb2497a0f4daebef2533d322697e6 2023-02-08 02:56:18,656 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 02:56:18,673 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 02:56:18,674 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:59034, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 02:56:18,680 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:18,680 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:18,681 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 02:56:18,682 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:46280, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 02:56:18,690 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ff2d66f21ddd4a54ae7dd612d1e466f1 first=Optional[r3] last=Optional[r6] 2023-02-08 02:56:18,691 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ff2d66f21ddd4a54ae7dd612d1e466f1}] 2023-02-08 02:56:18,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ff2d66f21ddd4a54ae7dd612d1e466f1 for inclusion in cbbfde4ca627bec304375d93283fccac/family1 2023-02-08 02:56:18,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-08 02:56:18,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 02:56:18,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for cbbfde4ca627bec304375d93283fccac: 2023-02-08 02:56:18,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ff2d66f21ddd4a54ae7dd612d1e466f1 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyPolicy__iap5bmok32sf8pjeojhpdpiouln3fmbb259tas8h063s0ure8qae9d9q7d1405tc/family1/ff2d66f21ddd4a54ae7dd612d1e466f1 2023-02-08 02:56:18,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyPolicy__iap5bmok32sf8pjeojhpdpiouln3fmbb259tas8h063s0ure8qae9d9q7d1405tc/family1/ff2d66f21ddd4a54ae7dd612d1e466f1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/0334c6cbd0864328a417536e5ad79fd2_SeqId_44_ 2023-02-08 02:56:18,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyPolicy__iap5bmok32sf8pjeojhpdpiouln3fmbb259tas8h063s0ure8qae9d9q7d1405tc/family1/ff2d66f21ddd4a54ae7dd612d1e466f1 into cbbfde4ca627bec304375d93283fccac/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/0334c6cbd0864328a417536e5ad79fd2_SeqId_44_ - updating store file list. 2023-02-08 02:56:18,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/0334c6cbd0864328a417536e5ad79fd2_SeqId_44_ into cbbfde4ca627bec304375d93283fccac/family1 2023-02-08 02:56:18,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyPolicy__iap5bmok32sf8pjeojhpdpiouln3fmbb259tas8h063s0ure8qae9d9q7d1405tc/family1/ff2d66f21ddd4a54ae7dd612d1e466f1 into cbbfde4ca627bec304375d93283fccac/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/0334c6cbd0864328a417536e5ad79fd2_SeqId_44_) 2023-02-08 02:56:18,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyPolicy__iap5bmok32sf8pjeojhpdpiouln3fmbb259tas8h063s0ure8qae9d9q7d1405tc/family1/ff2d66f21ddd4a54ae7dd612d1e466f1 2023-02-08 02:56:18,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-08 02:56:18,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-08 02:56:18,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(1912): cbbfde4ca627bec304375d93283fccac/family1 is initiating minor compaction 2023-02-08 02:56:18,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7715fb5d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:56:18,713 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of cbbfde4ca627bec304375d93283fccac/family1 in testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:18,713 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/9cbefeac1c6e485d8ca97cd5642ab668, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/ab316266d99e4945bd9a0222acf7f908, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/251351f03e4a40969a4b6b8bcbea500b, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/0c22ef7951ed44eda5e4e5f237d64de3, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/af4d5071f6fb410f8acbe12a340f6303, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/fe54659b68e94615a02270c5e059fbec, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/34cacd487f8c4b4abf12ebd33f149eca, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/3f9aa3cb12a5480485d79516fd9d62df, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/6c2ca342c17c4b2caba620eb7c045ec2, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/0334c6cbd0864328a417536e5ad79fd2_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp, totalSize=50.0 K 2023-02-08 02:56:18,713 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 9cbefeac1c6e485d8ca97cd5642ab668, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-08 02:56:18,713 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting ab316266d99e4945bd9a0222acf7f908, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-08 02:56:18,714 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 251351f03e4a40969a4b6b8bcbea500b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-08 02:56:18,714 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 0c22ef7951ed44eda5e4e5f237d64de3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-08 02:56:18,714 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting af4d5071f6fb410f8acbe12a340f6303, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-08 02:56:18,714 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting fe54659b68e94615a02270c5e059fbec, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-08 02:56:18,714 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 34cacd487f8c4b4abf12ebd33f149eca, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-08 02:56:18,714 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 3f9aa3cb12a5480485d79516fd9d62df, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-08 02:56:18,714 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 6c2ca342c17c4b2caba620eb7c045ec2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-08 02:56:18,714 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 0334c6cbd0864328a417536e5ad79fd2_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-08 02:56:18,715 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 02:56:18,716 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:56:18,718 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228c8f1fc1e826d494d9f9e2a913019fd47 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228c8f1fc1e826d494d9f9e2a913019fd47 2023-02-08 02:56:18,720 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231f7aac76b8caa48568de3d07eddc120c2 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231f7aac76b8caa48568de3d07eddc120c2 2023-02-08 02:56:18,721 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601011ce6a2beb64b4c189c476926b650699e to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601011ce6a2beb64b4c189c476926b650699e 2023-02-08 02:56:18,722 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010367d6b332a04241e3834dcdfa8001beef to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010367d6b332a04241e3834dcdfa8001beef 2023-02-08 02:56:18,722 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-08 02:56:18,722 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-08 02:56:18,723 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 02:56:18,723 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 02:56:18,723 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 02:56:18,723 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 02:56:18,723 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 02:56:18,723 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 02:56:18,723 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 02:56:18,723 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 02:56:18,746 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] throttle.PressureAwareThroughputController(145): cbbfde4ca627bec304375d93283fccac#family1#compaction#49 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-08 02:56:19,569 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp/family1/a03c51ec0c414a58ad8384471ac38f82 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/a03c51ec0c414a58ad8384471ac38f82 2023-02-08 02:56:19,575 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512056d2f5e266eec4b66a39d271fda6c59e2 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512056d2f5e266eec4b66a39d271fda6c59e2 2023-02-08 02:56:19,576 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 02:56:19,577 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in cbbfde4ca627bec304375d93283fccac/family1 of cbbfde4ca627bec304375d93283fccac into a03c51ec0c414a58ad8384471ac38f82(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 02:56:19,577 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for cbbfde4ca627bec304375d93283fccac: 2023-02-08 02:56:19,577 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1675824978713; duration=0sec 2023-02-08 02:56:19,578 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:56:19,598 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:19,598 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:19,606 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/da1f3812d69d448fa6608bb8a13e3f82 first=Optional[r00] last=Optional[r2] 2023-02-08 02:56:19,606 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/da1f3812d69d448fa6608bb8a13e3f82}] 2023-02-08 02:56:19,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/da1f3812d69d448fa6608bb8a13e3f82 for inclusion in cbbfde4ca627bec304375d93283fccac/family1 2023-02-08 02:56:19,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-08 02:56:19,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 02:56:19,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for cbbfde4ca627bec304375d93283fccac: 2023-02-08 02:56:19,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/da1f3812d69d448fa6608bb8a13e3f82 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5tjrufqj25tv0atsgangbkbcqksss4kis4ujkufp0lf2072lq0ir7bdv5rr2n7tc/family1/da1f3812d69d448fa6608bb8a13e3f82 2023-02-08 02:56:19,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5tjrufqj25tv0atsgangbkbcqksss4kis4ujkufp0lf2072lq0ir7bdv5rr2n7tc/family1/da1f3812d69d448fa6608bb8a13e3f82 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/2877ad2978f14f4ebf0c0ec6c589c2ce_SeqId_47_ 2023-02-08 02:56:19,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5tjrufqj25tv0atsgangbkbcqksss4kis4ujkufp0lf2072lq0ir7bdv5rr2n7tc/family1/da1f3812d69d448fa6608bb8a13e3f82 into cbbfde4ca627bec304375d93283fccac/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/2877ad2978f14f4ebf0c0ec6c589c2ce_SeqId_47_ - updating store file list. 2023-02-08 02:56:19,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/2877ad2978f14f4ebf0c0ec6c589c2ce_SeqId_47_ into cbbfde4ca627bec304375d93283fccac/family1 2023-02-08 02:56:19,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5tjrufqj25tv0atsgangbkbcqksss4kis4ujkufp0lf2072lq0ir7bdv5rr2n7tc/family1/da1f3812d69d448fa6608bb8a13e3f82 into cbbfde4ca627bec304375d93283fccac/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/2877ad2978f14f4ebf0c0ec6c589c2ce_SeqId_47_) 2023-02-08 02:56:19,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5tjrufqj25tv0atsgangbkbcqksss4kis4ujkufp0lf2072lq0ir7bdv5rr2n7tc/family1/da1f3812d69d448fa6608bb8a13e3f82 2023-02-08 02:56:19,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-08 02:56:19,628 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/9cbefeac1c6e485d8ca97cd5642ab668, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/ab316266d99e4945bd9a0222acf7f908, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/251351f03e4a40969a4b6b8bcbea500b, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/0c22ef7951ed44eda5e4e5f237d64de3, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/af4d5071f6fb410f8acbe12a340f6303, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/fe54659b68e94615a02270c5e059fbec, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/34cacd487f8c4b4abf12ebd33f149eca, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/3f9aa3cb12a5480485d79516fd9d62df, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/6c2ca342c17c4b2caba620eb7c045ec2, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/0334c6cbd0864328a417536e5ad79fd2_SeqId_44_] to archive 2023-02-08 02:56:19,630 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:56:19,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-08 02:56:19,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(1912): cbbfde4ca627bec304375d93283fccac/family1 is initiating minor compaction (all files) 2023-02-08 02:56:19,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@78d33694; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:56:19,630 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of cbbfde4ca627bec304375d93283fccac/family1 in testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:56:19,630 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/97e0315cf84c49d69397b14c6a9b6207, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/a03c51ec0c414a58ad8384471ac38f82, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/2877ad2978f14f4ebf0c0ec6c589c2ce_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp, totalSize=337.0 K 2023-02-08 02:56:19,631 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 97e0315cf84c49d69397b14c6a9b6207, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878815769 2023-02-08 02:56:19,631 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting a03c51ec0c414a58ad8384471ac38f82, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621215769 2023-02-08 02:56:19,632 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/9cbefeac1c6e485d8ca97cd5642ab668 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/9cbefeac1c6e485d8ca97cd5642ab668 2023-02-08 02:56:19,632 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 2877ad2978f14f4ebf0c0ec6c589c2ce_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878815769 2023-02-08 02:56:19,633 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 02:56:19,633 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/ab316266d99e4945bd9a0222acf7f908 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/ab316266d99e4945bd9a0222acf7f908 2023-02-08 02:56:19,634 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:56:19,635 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/251351f03e4a40969a4b6b8bcbea500b to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/251351f03e4a40969a4b6b8bcbea500b 2023-02-08 02:56:19,635 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113005babe92a88a43e29cce4cfe7d584e9a to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113005babe92a88a43e29cce4cfe7d584e9a 2023-02-08 02:56:19,637 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512015a1ccd71ecd74d2d8d3b7fd232df5a53 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512015a1ccd71ecd74d2d8d3b7fd232df5a53 2023-02-08 02:56:19,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/0c22ef7951ed44eda5e4e5f237d64de3 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/0c22ef7951ed44eda5e4e5f237d64de3 2023-02-08 02:56:19,638 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512054e1d4bd3ed0c4c22b809fed39861f37b to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512054e1d4bd3ed0c4c22b809fed39861f37b 2023-02-08 02:56:19,638 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-02-08 02:56:19,638 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-08 02:56:19,638 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/af4d5071f6fb410f8acbe12a340f6303 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/af4d5071f6fb410f8acbe12a340f6303 2023-02-08 02:56:19,638 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 02:56:19,638 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 02:56:19,638 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:56:19,639 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 02:56:19,640 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/fe54659b68e94615a02270c5e059fbec to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/fe54659b68e94615a02270c5e059fbec 2023-02-08 02:56:19,641 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.5310 sec 2023-02-08 02:56:19,641 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/34cacd487f8c4b4abf12ebd33f149eca to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/34cacd487f8c4b4abf12ebd33f149eca 2023-02-08 02:56:19,643 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/3f9aa3cb12a5480485d79516fd9d62df to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/3f9aa3cb12a5480485d79516fd9d62df 2023-02-08 02:56:19,644 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/6c2ca342c17c4b2caba620eb7c045ec2 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/6c2ca342c17c4b2caba620eb7c045ec2 2023-02-08 02:56:19,644 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/0334c6cbd0864328a417536e5ad79fd2_SeqId_44_ to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/0334c6cbd0864328a417536e5ad79fd2_SeqId_44_ 2023-02-08 02:56:19,649 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] throttle.PressureAwareThroughputController(145): cbbfde4ca627bec304375d93283fccac#family1#compaction#50 average throughput is 19.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-08 02:56:19,727 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=249 (was 245) - Thread LEAK? -, OpenFileDescriptor=604 (was 587) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=179 (was 210), ProcessCount=174 (was 174), AvailableMemoryMB=3644 (was 3820) 2023-02-08 02:56:19,738 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=249, OpenFileDescriptor=604, MaxFileDescriptor=60000, SystemLoadAverage=179, ProcessCount=174, AvailableMemoryMB=3644 2023-02-08 02:56:19,739 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:19,739 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:19,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-08 02:56:19,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:19,743 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 02:56:19,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-02-08 02:56:19,743 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:19,743 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:19,743 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 02:56:19,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-08 02:56:19,745 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:19,746 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42 empty. 2023-02-08 02:56:19,746 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:19,746 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-02-08 02:56:19,844 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:19,845 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:19,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-08 02:56:20,047 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:20,047 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:20,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-08 02:56:20,077 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 02:56:20,077 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a2e5c79 to 127.0.0.1:49602 2023-02-08 02:56:20,077 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:56:20,077 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 02:56:20,077 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b1b55ce to 127.0.0.1:49602 2023-02-08 02:56:20,077 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:56:20,077 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 02:56:20,078 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x304f0918 to 127.0.0.1:49602 2023-02-08 02:56:20,078 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:56:20,157 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-08 02:56:20,159 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7671): creating {ENCODED => db39cc04ed2076379d0004c2e09c0e42, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp 2023-02-08 02:56:20,170 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:56:20,170 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1603): Closing db39cc04ed2076379d0004c2e09c0e42, disabling compactions & flushes 2023-02-08 02:56:20,170 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:20,170 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:20,170 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. after waiting 0 ms 2023-02-08 02:56:20,170 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:20,170 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:20,171 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1557): Region close journal for db39cc04ed2076379d0004c2e09c0e42: Waiting for close lock at 1675824980170Disabling compacts and flushes for region at 1675824980170Disabling writes for close at 1675824980170Writing region close event to WAL at 1675824980170Closed at 1675824980170 2023-02-08 02:56:20,174 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 02:56:20,175 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675824980175"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675824980175"}]},"ts":"1675824980175"} 2023-02-08 02:56:20,177 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 02:56:20,178 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 02:56:20,178 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675824980178"}]},"ts":"1675824980178"} 2023-02-08 02:56:20,179 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-02-08 02:56:20,204 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=db39cc04ed2076379d0004c2e09c0e42, ASSIGN}] 2023-02-08 02:56:20,205 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=db39cc04ed2076379d0004c2e09c0e42, ASSIGN 2023-02-08 02:56:20,206 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=db39cc04ed2076379d0004c2e09c0e42, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=false 2023-02-08 02:56:20,348 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:20,349 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:20,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-08 02:56:20,357 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=db39cc04ed2076379d0004c2e09c0e42, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:20,357 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675824980357"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675824980357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675824980357"}]},"ts":"1675824980357"} 2023-02-08 02:56:20,359 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure db39cc04ed2076379d0004c2e09c0e42, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:56:20,490 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/.tmp/family1/f86c76ff2b10470bb0866eddce85bf9b as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/f86c76ff2b10470bb0866eddce85bf9b 2023-02-08 02:56:20,496 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in cbbfde4ca627bec304375d93283fccac/family1 of cbbfde4ca627bec304375d93283fccac into f86c76ff2b10470bb0866eddce85bf9b(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 02:56:20,496 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for cbbfde4ca627bec304375d93283fccac: 2023-02-08 02:56:20,496 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1675824979630; duration=0sec 2023-02-08 02:56:20,496 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:56:20,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/97e0315cf84c49d69397b14c6a9b6207, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/a03c51ec0c414a58ad8384471ac38f82, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/2877ad2978f14f4ebf0c0ec6c589c2ce_SeqId_47_] to archive 2023-02-08 02:56:20,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:56:20,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:20,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => db39cc04ed2076379d0004c2e09c0e42, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.', STARTKEY => '', ENDKEY => ''} 2023-02-08 02:56:20,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:20,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:56:20,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:20,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:20,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/97e0315cf84c49d69397b14c6a9b6207 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/97e0315cf84c49d69397b14c6a9b6207 2023-02-08 02:56:20,523 INFO [StoreOpener-db39cc04ed2076379d0004c2e09c0e42-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:20,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/a03c51ec0c414a58ad8384471ac38f82 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/a03c51ec0c414a58ad8384471ac38f82 2023-02-08 02:56:20,524 DEBUG [StoreOpener-db39cc04ed2076379d0004c2e09c0e42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1 2023-02-08 02:56:20,524 DEBUG [StoreOpener-db39cc04ed2076379d0004c2e09c0e42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1 2023-02-08 02:56:20,525 INFO [StoreOpener-db39cc04ed2076379d0004c2e09c0e42-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db39cc04ed2076379d0004c2e09c0e42 columnFamilyName family1 2023-02-08 02:56:20,525 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/2877ad2978f14f4ebf0c0ec6c589c2ce_SeqId_47_ to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/family1/2877ad2978f14f4ebf0c0ec6c589c2ce_SeqId_47_ 2023-02-08 02:56:20,526 INFO [StoreOpener-db39cc04ed2076379d0004c2e09c0e42-1] regionserver.HStore(310): Store=db39cc04ed2076379d0004c2e09c0e42/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:56:20,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:20,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:20,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:20,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:56:20,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened db39cc04ed2076379d0004c2e09c0e42; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59105333, jitterRate=-0.11926190555095673}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 02:56:20,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for db39cc04ed2076379d0004c2e09c0e42: Running coprocessor pre-open hook at 1675824980521Writing region info on filesystem at 1675824980521Initializing all the Stores at 1675824980522 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675824980522Cleaning up temporary data from old regions at 1675824980528 (+6 ms)Cleaning up detritus from prior splits at 1675824980528Running coprocessor post-open hooks at 1675824980531 (+3 ms)Region opened successfully at 1675824980531 2023-02-08 02:56:20,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42., pid=41, masterSystemTime=1675824980511 2023-02-08 02:56:20,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:20,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:20,534 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=db39cc04ed2076379d0004c2e09c0e42, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:20,534 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675824980534"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675824980534"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675824980534"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675824980534"}]},"ts":"1675824980534"} 2023-02-08 02:56:20,536 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-02-08 02:56:20,536 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure db39cc04ed2076379d0004c2e09c0e42, server=jenkins-hbase12.apache.org,44577,1675824910652 in 176 msec 2023-02-08 02:56:20,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-02-08 02:56:20,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=db39cc04ed2076379d0004c2e09c0e42, ASSIGN in 332 msec 2023-02-08 02:56:20,538 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 02:56:20,539 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675824980538"}]},"ts":"1675824980538"} 2023-02-08 02:56:20,540 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-02-08 02:56:20,615 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 02:56:20,616 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 875 msec 2023-02-08 02:56:20,850 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:20,850 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:20,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-08 02:56:20,851 INFO [Listener at localhost.localdomain/44017] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-02-08 02:56:20,871 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:20,871 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:20,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:20,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:20,873 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 02:56:20,873 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:20,873 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-08 02:56:20,873 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-08 02:56:20,874 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:20,874 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:20,877 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:20,877 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:20,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:20,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:20,878 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:20,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:20,878 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:20,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:20,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:20,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:20,878 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:20,879 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:20,879 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-08 02:56:20,879 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:20,879 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-08 02:56:20,879 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:20,879 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:20,879 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:20,879 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. started... 2023-02-08 02:56:20,880 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing db39cc04ed2076379d0004c2e09c0e42 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-08 02:56:21,301 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113067df4b40c021470fb14e581816945bc5 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113067df4b40c021470fb14e581816945bc5 2023-02-08 02:56:21,305 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp/family1/cdea468b0153417caae6389ac1382bca 2023-02-08 02:56:21,311 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp/family1/cdea468b0153417caae6389ac1382bca as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/cdea468b0153417caae6389ac1382bca 2023-02-08 02:56:21,316 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/cdea468b0153417caae6389ac1382bca, entries=1000, sequenceid=5, filesize=191.4 K 2023-02-08 02:56:21,317 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for db39cc04ed2076379d0004c2e09c0e42 in 438ms, sequenceid=5, compaction requested=false 2023-02-08 02:56:21,317 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 02:56:21,318 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for db39cc04ed2076379d0004c2e09c0e42: 2023-02-08 02:56:21,318 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:21,318 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:21,318 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:21,318 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:21,318 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-08 02:56:21,318 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-08 02:56:21,499 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:21,499 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:21,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:21,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:21,500 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,501 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:21,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:21,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:21,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:21,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:21,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-08 02:56:21,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ef86faf[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:21,506 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-08 02:56:21,506 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,550 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,550 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-08 02:56:21,550 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-08 02:56:21,550 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:21,550 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:21,550 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:21,561 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-08 02:56:21,561 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:21,562 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-08 02:56:21,561 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:21,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:21,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:21,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:21,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:21,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:21,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:21,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:21,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:21,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:21,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-08 02:56:21,569 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-08 02:56:21,569 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:21,569 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:21,569 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,570 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:21,582 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,582 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,583 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:21,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:21,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:21,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:21,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:21,584 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:21,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:21,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:21,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,587 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:21,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:21,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:21,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:21,603 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:21,603 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:21,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:21,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:21,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 02:56:21,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:21,604 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:21,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-08 02:56:21,604 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:21,604 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:21,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:21,604 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:21,604 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,605 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:21,605 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:21,605 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,605 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,605 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,705 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:21,706 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:21,706 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:21,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:21,715 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:21,715 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:21,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:21,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:21,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,719 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 02:56:21,719 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:21,719 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-08 02:56:21,719 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-08 02:56:21,720 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,720 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,730 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:21,730 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:21,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:21,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:21,731 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:21,731 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:21,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:21,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,734 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,734 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-08 02:56:21,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:21,734 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-08 02:56:21,734 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:21,735 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-08 02:56:21,735 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:21,735 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:21,735 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:21,735 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. started... 2023-02-08 02:56:21,735 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing db39cc04ed2076379d0004c2e09c0e42 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-08 02:56:22,151 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112858c2b442826c494faa565ea7ce6ee9f1 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112858c2b442826c494faa565ea7ce6ee9f1 2023-02-08 02:56:22,558 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp/family1/4cd11160b93d4da496246c52500bae13 2023-02-08 02:56:22,569 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp/family1/4cd11160b93d4da496246c52500bae13 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/4cd11160b93d4da496246c52500bae13 2023-02-08 02:56:22,574 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/4cd11160b93d4da496246c52500bae13, entries=1, sequenceid=9, filesize=5.0 K 2023-02-08 02:56:22,575 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for db39cc04ed2076379d0004c2e09c0e42 in 840ms, sequenceid=9, compaction requested=false 2023-02-08 02:56:22,575 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for db39cc04ed2076379d0004c2e09c0e42: 2023-02-08 02:56:22,575 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:22,576 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:22,576 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:22,576 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:22,576 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-08 02:56:22,576 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-08 02:56:22,625 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:22,625 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:22,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:22,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:22,626 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,626 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:22,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:22,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:22,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:22,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:22,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-08 02:56:22,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56249217[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:22,631 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-08 02:56:22,631 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,644 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,644 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-08 02:56:22,645 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-08 02:56:22,645 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:22,645 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:22,645 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:22,656 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:22,656 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-08 02:56:22,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:22,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:22,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:22,656 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:22,656 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-08 02:56:22,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:22,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:22,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:22,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:22,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:22,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:22,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-08 02:56:22,660 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-08 02:56:22,660 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:22,660 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:22,660 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,660 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:22,666 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,667 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:22,666 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:22,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:22,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:22,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:22,667 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:22,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:22,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:22,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,669 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:22,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:22,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:22,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:22,708 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:22,708 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:22,708 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,708 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,708 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:22,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:22,708 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:22,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:22,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 02:56:22,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:22,709 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-08 02:56:22,708 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:22,709 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,709 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,710 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,710 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:22,710 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:22,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:22,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:22,810 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:22,810 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:22,811 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:22,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:22,817 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:22,817 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:22,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:22,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:22,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,822 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 02:56:22,822 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:22,822 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-08 02:56:22,822 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-08 02:56:22,823 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,823 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,844 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:22,844 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:22,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:22,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:22,845 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:22,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,845 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:22,846 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:22,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,846 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,846 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-08 02:56:22,846 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:22,846 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-08 02:56:22,846 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:22,847 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-08 02:56:22,847 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:22,847 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:22,847 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:22,847 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. started... 2023-02-08 02:56:22,847 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing db39cc04ed2076379d0004c2e09c0e42 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:23,268 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ff2bc2871c054d24a91fdc5a7148826a to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201ff2bc2871c054d24a91fdc5a7148826a 2023-02-08 02:56:23,676 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp/family1/447db08b0038441cabf0f75f6d664d32 2023-02-08 02:56:23,684 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp/family1/447db08b0038441cabf0f75f6d664d32 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/447db08b0038441cabf0f75f6d664d32 2023-02-08 02:56:23,691 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/447db08b0038441cabf0f75f6d664d32, entries=1, sequenceid=13, filesize=5.0 K 2023-02-08 02:56:23,692 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db39cc04ed2076379d0004c2e09c0e42 in 845ms, sequenceid=13, compaction requested=true 2023-02-08 02:56:23,692 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for db39cc04ed2076379d0004c2e09c0e42: 2023-02-08 02:56:23,693 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:23,693 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:23,693 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:23,693 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:23,693 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-08 02:56:23,693 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-08 02:56:23,772 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:23,772 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:23,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:23,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:23,773 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,773 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:23,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:23,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:23,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:23,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:23,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-08 02:56:23,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fa3036[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:23,776 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-08 02:56:23,776 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,782 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,783 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-08 02:56:23,783 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-08 02:56:23,783 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:23,783 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:23,783 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:23,793 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:23,793 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-08 02:56:23,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:23,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:23,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:23,793 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:23,793 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-08 02:56:23,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:23,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:23,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:23,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:23,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:23,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:23,797 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-08 02:56:23,797 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-08 02:56:23,797 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:23,797 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:23,797 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,797 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:23,803 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,803 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,804 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:23,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:23,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:23,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:23,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:23,804 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:23,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:23,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:23,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,805 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:23,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:23,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:23,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:23,814 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:23,814 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:23,814 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:23,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-08 02:56:23,814 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:23,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:23,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 02:56:23,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:23,814 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:23,814 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,814 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:23,814 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,814 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:23,814 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:23,814 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:23,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:23,814 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,915 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:23,915 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:23,915 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:23,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:23,926 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:23,926 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:23,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:23,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:23,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,931 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 02:56:23,931 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:23,931 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-08 02:56:23,931 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-08 02:56:23,932 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,932 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,940 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:23,940 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:23,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:23,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:23,941 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:23,941 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:23,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,943 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:23,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,944 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,945 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-08 02:56:23,945 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:23,945 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-08 02:56:23,945 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:23,945 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-08 02:56:23,946 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:23,946 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:23,946 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:23,946 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. started... 2023-02-08 02:56:23,946 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing db39cc04ed2076379d0004c2e09c0e42 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:24,370 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120502f13f5eb45b414c85a0e60ffb63d3c3 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120502f13f5eb45b414c85a0e60ffb63d3c3 2023-02-08 02:56:24,778 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp/family1/3df2ee9c2cd34e5d8e5bd39df87f62ff 2023-02-08 02:56:24,788 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp/family1/3df2ee9c2cd34e5d8e5bd39df87f62ff as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/3df2ee9c2cd34e5d8e5bd39df87f62ff 2023-02-08 02:56:24,795 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/3df2ee9c2cd34e5d8e5bd39df87f62ff, entries=1, sequenceid=17, filesize=5.0 K 2023-02-08 02:56:24,796 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db39cc04ed2076379d0004c2e09c0e42 in 850ms, sequenceid=17, compaction requested=true 2023-02-08 02:56:24,796 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for db39cc04ed2076379d0004c2e09c0e42: 2023-02-08 02:56:24,796 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:24,796 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:24,796 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:24,796 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:24,796 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-08 02:56:24,796 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-08 02:56:24,845 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:24,845 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:24,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:24,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:24,846 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,846 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:24,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:24,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:24,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:24,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:24,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-08 02:56:24,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46cca84a[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:24,849 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-08 02:56:24,850 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,856 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,856 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-08 02:56:24,856 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-08 02:56:24,856 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:24,856 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:24,856 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:24,866 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-08 02:56:24,866 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:24,866 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:24,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:24,866 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-08 02:56:24,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:24,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:24,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:24,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:24,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:24,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:24,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:24,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:24,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-08 02:56:24,868 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-08 02:56:24,868 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:24,868 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:24,868 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,868 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:24,877 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,877 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:24,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:24,877 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:24,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,877 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:24,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:24,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:24,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:24,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:24,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,878 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:24,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:24,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:24,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:24,887 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:24,887 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:24,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:24,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 02:56:24,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:24,887 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:24,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:24,887 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:24,887 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,888 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,888 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:24,888 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:24,888 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:24,888 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:24,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:24,888 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,888 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:24,988 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:24,989 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:24,989 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:24,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:24,998 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:24,999 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:25,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:25,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:25,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,004 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 02:56:25,004 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:25,004 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-08 02:56:25,004 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-08 02:56:25,005 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,006 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,041 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:25,041 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:25,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:25,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:25,042 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:25,042 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:25,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,043 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:25,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,045 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,045 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-08 02:56:25,045 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,045 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-08 02:56:25,046 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:25,046 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-08 02:56:25,046 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:25,046 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:25,046 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:25,046 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. started... 2023-02-08 02:56:25,047 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing db39cc04ed2076379d0004c2e09c0e42 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:25,472 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228066407ac8e8d46a8bc208a9f0f97535d to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228066407ac8e8d46a8bc208a9f0f97535d 2023-02-08 02:56:25,880 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp/family1/335adce7240c461ea82fa81aa12789da 2023-02-08 02:56:25,886 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp/family1/335adce7240c461ea82fa81aa12789da as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/335adce7240c461ea82fa81aa12789da 2023-02-08 02:56:25,891 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/335adce7240c461ea82fa81aa12789da, entries=1, sequenceid=21, filesize=5.0 K 2023-02-08 02:56:25,892 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db39cc04ed2076379d0004c2e09c0e42 in 845ms, sequenceid=21, compaction requested=true 2023-02-08 02:56:25,892 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for db39cc04ed2076379d0004c2e09c0e42: 2023-02-08 02:56:25,892 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:25,892 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:25,892 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:25,892 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:25,892 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-08 02:56:25,892 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-08 02:56:25,940 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:25,940 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:25,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:25,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:25,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:25,940 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,941 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:25,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:25,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:25,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:25,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-08 02:56:25,942 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-08 02:56:25,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b34322b[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:25,942 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,950 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,951 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:25,951 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:25,951 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-08 02:56:25,951 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-08 02:56:25,951 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:25,961 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:25,961 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-08 02:56:25,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:25,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:25,961 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:25,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:25,961 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-08 02:56:25,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:25,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:25,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:25,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:25,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:25,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:25,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-08 02:56:25,964 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-08 02:56:25,964 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:25,964 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:25,964 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,964 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:25,971 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,972 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:25,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,972 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:25,972 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:25,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:25,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,974 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:25,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:25,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:25,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:25,982 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:25,982 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,982 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,982 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:25,982 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:25,982 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-08 02:56:25,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 02:56:25,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:25,982 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:25,982 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:25,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:25,982 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:25,983 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:25,983 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,983 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:25,983 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:25,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:25,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:26,052 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 02:56:26,083 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:26,083 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:26,083 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:26,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:26,087 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:26,087 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:26,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:26,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:26,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:26,089 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 02:56:26,089 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:26,089 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-08 02:56:26,089 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-08 02:56:26,089 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:26,089 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:26,098 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:26,098 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:26,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:26,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:26,098 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:26,098 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:26,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:26,098 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:26,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:26,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:26,099 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:26,099 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-08 02:56:26,099 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:26,099 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-08 02:56:26,099 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:26,099 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-08 02:56:26,099 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:26,099 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:26,099 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:26,099 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. started... 2023-02-08 02:56:26,099 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing db39cc04ed2076379d0004c2e09c0e42 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:26,518 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ad3370a6017c405aaf5f32ac671eda97 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231ad3370a6017c405aaf5f32ac671eda97 2023-02-08 02:56:26,927 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp/family1/3d622f84845a4d3a9d063d92dc931cf2 2023-02-08 02:56:26,938 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp/family1/3d622f84845a4d3a9d063d92dc931cf2 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/3d622f84845a4d3a9d063d92dc931cf2 2023-02-08 02:56:26,943 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/3d622f84845a4d3a9d063d92dc931cf2, entries=1, sequenceid=25, filesize=5.0 K 2023-02-08 02:56:26,944 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db39cc04ed2076379d0004c2e09c0e42 in 845ms, sequenceid=25, compaction requested=true 2023-02-08 02:56:26,944 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for db39cc04ed2076379d0004c2e09c0e42: 2023-02-08 02:56:26,944 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:26,944 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:26,944 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:26,944 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:26,944 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-08 02:56:26,945 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-08 02:56:27,003 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:27,003 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:27,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:27,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:27,004 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,004 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:27,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:27,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:27,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:27,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:27,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-08 02:56:27,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4972ab70[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:27,006 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-08 02:56:27,007 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,014 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,014 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-08 02:56:27,014 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-08 02:56:27,014 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:27,014 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:27,014 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:27,024 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-08 02:56:27,024 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:27,024 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-08 02:56:27,024 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:27,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:27,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-08 02:56:27,027 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-08 02:56:27,027 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:27,027 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:27,027 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,027 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:27,035 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,035 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:27,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:27,035 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:27,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:27,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:27,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:27,035 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:27,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:27,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,037 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:27,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:27,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:27,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:27,123 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:27,123 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,123 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,123 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:27,124 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:27,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 02:56:27,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:27,124 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:27,124 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,124 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,124 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:27,124 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:27,124 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:27,124 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-08 02:56:27,124 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:27,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:27,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:27,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:27,225 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:27,225 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:27,225 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:27,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:27,235 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:27,235 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:27,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:27,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:27,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,239 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 02:56:27,239 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:27,239 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-08 02:56:27,239 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-08 02:56:27,240 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,240 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,266 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:27,266 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:27,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:27,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:27,267 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:27,267 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:27,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:27,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,268 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,268 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-08 02:56:27,268 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:27,269 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-08 02:56:27,269 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:27,269 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-08 02:56:27,269 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:27,269 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:27,269 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:27,269 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. started... 2023-02-08 02:56:27,269 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing db39cc04ed2076379d0004c2e09c0e42 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:27,686 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601018047720983a84090a0d5d467bc770c0d to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601018047720983a84090a0d5d467bc770c0d 2023-02-08 02:56:28,095 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp/family1/ab450db5543d455d876ad2364eac45b4 2023-02-08 02:56:28,107 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp/family1/ab450db5543d455d876ad2364eac45b4 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/ab450db5543d455d876ad2364eac45b4 2023-02-08 02:56:28,114 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/ab450db5543d455d876ad2364eac45b4, entries=1, sequenceid=29, filesize=5.0 K 2023-02-08 02:56:28,115 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db39cc04ed2076379d0004c2e09c0e42 in 846ms, sequenceid=29, compaction requested=true 2023-02-08 02:56:28,115 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for db39cc04ed2076379d0004c2e09c0e42: 2023-02-08 02:56:28,115 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:28,115 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:28,115 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:28,115 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:28,115 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-08 02:56:28,115 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-08 02:56:28,171 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:28,171 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:28,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:28,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:28,172 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:28,172 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:28,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:28,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:28,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:28,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-08 02:56:28,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f5f49e8[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:28,174 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-08 02:56:28,174 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,182 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,182 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-08 02:56:28,182 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-08 02:56:28,182 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:28,182 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:28,182 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:28,476 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:28,476 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-08 02:56:28,476 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:28,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:28,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:28,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:28,476 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-08 02:56:28,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:28,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:28,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:28,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:28,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:28,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:28,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-08 02:56:28,482 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-08 02:56:28,482 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:28,482 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:28,482 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,482 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:28,542 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,543 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:28,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,542 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:28,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:28,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:28,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:28,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:28,545 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:28,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:28,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,548 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:28,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:28,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:28,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:28,614 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:28,614 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:28,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:28,614 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:28,614 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:28,614 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,614 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,615 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:28,615 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,615 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,615 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 02:56:28,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:28,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-08 02:56:28,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:28,615 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:28,615 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:28,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:28,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:28,716 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:28,716 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:28,716 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:28,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:28,724 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:28,725 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:28,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:28,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:28,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,729 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 02:56:28,729 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:28,729 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-08 02:56:28,729 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-08 02:56:28,730 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,730 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,740 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:28,740 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:28,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:28,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:28,741 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:28,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,741 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:28,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:28,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,743 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,744 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-08 02:56:28,744 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:28,744 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-08 02:56:28,744 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:28,744 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-08 02:56:28,744 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:28,744 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:28,745 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:28,745 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. started... 2023-02-08 02:56:28,745 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing db39cc04ed2076379d0004c2e09c0e42 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:29,169 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030a4bb87b260843cfbd23187f8c09d20f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601030a4bb87b260843cfbd23187f8c09d20f 2023-02-08 02:56:29,577 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp/family1/6c3eded2483b44dd92605e1540575a57 2023-02-08 02:56:29,584 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp/family1/6c3eded2483b44dd92605e1540575a57 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/6c3eded2483b44dd92605e1540575a57 2023-02-08 02:56:29,588 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/6c3eded2483b44dd92605e1540575a57, entries=1, sequenceid=33, filesize=5.0 K 2023-02-08 02:56:29,588 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db39cc04ed2076379d0004c2e09c0e42 in 843ms, sequenceid=33, compaction requested=true 2023-02-08 02:56:29,588 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for db39cc04ed2076379d0004c2e09c0e42: 2023-02-08 02:56:29,588 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:29,588 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:29,588 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:29,588 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:29,588 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-08 02:56:29,589 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-08 02:56:29,645 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:29,645 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:29,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:29,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:29,646 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:29,646 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:29,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:29,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:29,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:29,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-08 02:56:29,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3cf22cb1[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:29,649 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-08 02:56:29,649 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,656 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,656 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-08 02:56:29,656 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-08 02:56:29,656 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:29,656 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:29,657 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:29,666 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-08 02:56:29,667 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:29,667 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-08 02:56:29,666 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:29,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:29,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:29,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:29,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:29,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:29,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:29,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:29,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:29,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:29,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-08 02:56:29,677 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-08 02:56:29,677 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:29,677 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:29,677 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,677 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:29,687 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,687 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,687 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:29,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:29,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:29,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:29,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:29,689 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:29,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:29,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:29,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,692 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:29,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:29,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:29,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:29,708 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:29,708 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:29,708 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,708 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:29,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:29,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:29,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 02:56:29,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:29,709 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:29,709 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,709 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-08 02:56:29,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:29,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:29,710 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:29,710 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:29,709 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:29,710 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,710 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,710 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,810 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:29,811 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:29,811 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:29,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:29,823 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:29,823 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:29,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:29,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:29,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,828 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 02:56:29,828 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:29,828 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-08 02:56:29,828 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-08 02:56:29,829 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,829 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,835 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:29,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:29,835 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:29,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:29,836 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:29,836 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:29,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,837 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:29,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,838 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,838 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-08 02:56:29,838 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:29,838 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-08 02:56:29,838 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:29,838 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-08 02:56:29,839 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:29,839 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:29,839 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:29,839 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. started... 2023-02-08 02:56:29,839 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing db39cc04ed2076379d0004c2e09c0e42 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:30,257 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907a1409b38670f4ff598861d1603c388b6 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907a1409b38670f4ff598861d1603c388b6 2023-02-08 02:56:30,664 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp/family1/f9d7d42931484b92b33d015fd8cdf0fc 2023-02-08 02:56:30,674 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp/family1/f9d7d42931484b92b33d015fd8cdf0fc as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/f9d7d42931484b92b33d015fd8cdf0fc 2023-02-08 02:56:30,679 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/f9d7d42931484b92b33d015fd8cdf0fc, entries=1, sequenceid=37, filesize=5.0 K 2023-02-08 02:56:30,680 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db39cc04ed2076379d0004c2e09c0e42 in 841ms, sequenceid=37, compaction requested=true 2023-02-08 02:56:30,680 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for db39cc04ed2076379d0004c2e09c0e42: 2023-02-08 02:56:30,680 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:30,681 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:30,681 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:30,681 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:30,681 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-08 02:56:30,681 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-08 02:56:30,687 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,687 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:30,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:30,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:30,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:30,687 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,687 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:30,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:30,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:30,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:30,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:30,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-08 02:56:30,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26cdf46e[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:30,689 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-08 02:56:30,689 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,697 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,698 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-08 02:56:30,698 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:30,698 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:30,698 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-08 02:56:30,698 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:30,708 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-08 02:56:30,708 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:30,708 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:30,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:30,708 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-08 02:56:30,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:30,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:30,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:30,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:30,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:30,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:30,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-08 02:56:30,711 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-08 02:56:30,711 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:30,711 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:30,711 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,711 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:30,729 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,729 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:30,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:30,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,729 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:30,730 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:30,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:30,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:30,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:30,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:30,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,731 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:30,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:30,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:30,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:30,803 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:30,803 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,803 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,803 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:30,803 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:30,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:30,803 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-08 02:56:30,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:30,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 02:56:30,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:30,803 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:30,803 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,803 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:30,803 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,803 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,803 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:30,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:30,803 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:30,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:30,904 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:30,904 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:30,904 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:30,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:30,908 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:30,908 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:30,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:30,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:30,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,911 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 02:56:30,911 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:30,911 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-08 02:56:30,911 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-08 02:56:30,912 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,912 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,919 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:30,919 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:30,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:30,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:30,919 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:30,919 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:30,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:30,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,920 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,920 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-08 02:56:30,920 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:30,920 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-08 02:56:30,920 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:30,920 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-08 02:56:30,920 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:30,920 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:30,920 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:30,921 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. started... 2023-02-08 02:56:30,921 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing db39cc04ed2076379d0004c2e09c0e42 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:31,345 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112052de392247744048a060d53c4ad00a00 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112052de392247744048a060d53c4ad00a00 2023-02-08 02:56:31,752 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp/family1/9a98ff35525b43ff9bcaeed4489b335f 2023-02-08 02:56:31,759 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp/family1/9a98ff35525b43ff9bcaeed4489b335f as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/9a98ff35525b43ff9bcaeed4489b335f 2023-02-08 02:56:31,765 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/9a98ff35525b43ff9bcaeed4489b335f, entries=1, sequenceid=41, filesize=5.0 K 2023-02-08 02:56:31,766 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db39cc04ed2076379d0004c2e09c0e42 in 845ms, sequenceid=41, compaction requested=true 2023-02-08 02:56:31,766 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for db39cc04ed2076379d0004c2e09c0e42: 2023-02-08 02:56:31,766 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:31,766 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:31,767 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:31,767 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:31,767 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-08 02:56:31,767 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-08 02:56:31,771 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:31,771 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:31,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:31,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:31,771 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,771 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:31,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:31,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:31,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:31,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:31,773 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-08 02:56:31,773 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ab8f2ec[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:31,773 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-08 02:56:31,773 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,782 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,782 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-08 02:56:31,782 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-08 02:56:31,782 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:31,782 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:31,782 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:31,792 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-08 02:56:31,792 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:31,792 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-08 02:56:31,792 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:31,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:31,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:31,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:31,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:31,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:31,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:31,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:31,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:31,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:31,795 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-08 02:56:31,795 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-08 02:56:31,795 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:31,795 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:31,795 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,795 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:31,803 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,803 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:31,803 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:31,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:31,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:31,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:31,803 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:31,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:31,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:31,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,804 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:31,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:31,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:31,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:31,813 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:31,813 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:31,813 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,813 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-08 02:56:31,813 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,813 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:31,814 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 02:56:31,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:31,813 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:31,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:31,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:31,813 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:31,814 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,814 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,814 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:31,814 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:31,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:31,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:31,914 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:31,914 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:31,914 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:31,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:31,916 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:31,918 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-08 02:56:31,919 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-08 02:56:31,923 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:56:31,923 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675825591923 2023-02-08 02:56:31,926 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 02:56:31,927 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-08 02:56:31,927 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 02:56:31,928 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] zookeeper.ReadOnlyZKClient(139): Connect 0x5fd636b9 to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:56:31,940 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a3e64d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:56:31,941 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:32,799 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e9785dc7a03c4fe4b1896634dcd4b458 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103e9785dc7a03c4fe4b1896634dcd4b458 2023-02-08 02:56:32,800 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 02:56:32,817 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 02:56:32,818 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:42030, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 02:56:32,823 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:32,824 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:32,824 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 02:56:32,826 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:59420, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 02:56:32,835 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4de50e683d33414796f4ea33c7d533a5 first=Optional[r3] last=Optional[r6] 2023-02-08 02:56:32,836 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4de50e683d33414796f4ea33c7d533a5}] 2023-02-08 02:56:32,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4de50e683d33414796f4ea33c7d533a5 for inclusion in db39cc04ed2076379d0004c2e09c0e42/family1 2023-02-08 02:56:32,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-08 02:56:32,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 02:56:32,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for db39cc04ed2076379d0004c2e09c0e42: 2023-02-08 02:56:32,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4de50e683d33414796f4ea33c7d533a5 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__uok3rv8j2eeo24t2p77n37ka0iiomglnf7b9fhlkffri4nppupimcs9ab2obl645/family1/4de50e683d33414796f4ea33c7d533a5 2023-02-08 02:56:32,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__uok3rv8j2eeo24t2p77n37ka0iiomglnf7b9fhlkffri4nppupimcs9ab2obl645/family1/4de50e683d33414796f4ea33c7d533a5 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/ca389fd0a3634085b1f83441069a445f_SeqId_44_ 2023-02-08 02:56:32,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__uok3rv8j2eeo24t2p77n37ka0iiomglnf7b9fhlkffri4nppupimcs9ab2obl645/family1/4de50e683d33414796f4ea33c7d533a5 into db39cc04ed2076379d0004c2e09c0e42/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/ca389fd0a3634085b1f83441069a445f_SeqId_44_ - updating store file list. 2023-02-08 02:56:32,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/ca389fd0a3634085b1f83441069a445f_SeqId_44_ into db39cc04ed2076379d0004c2e09c0e42/family1 2023-02-08 02:56:32,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__uok3rv8j2eeo24t2p77n37ka0iiomglnf7b9fhlkffri4nppupimcs9ab2obl645/family1/4de50e683d33414796f4ea33c7d533a5 into db39cc04ed2076379d0004c2e09c0e42/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/ca389fd0a3634085b1f83441069a445f_SeqId_44_) 2023-02-08 02:56:32,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__uok3rv8j2eeo24t2p77n37ka0iiomglnf7b9fhlkffri4nppupimcs9ab2obl645/family1/4de50e683d33414796f4ea33c7d533a5 2023-02-08 02:56:32,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-08 02:56:32,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-08 02:56:32,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(1912): db39cc04ed2076379d0004c2e09c0e42/family1 is initiating minor compaction 2023-02-08 02:56:32,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3da39036; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:56:32,855 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of db39cc04ed2076379d0004c2e09c0e42/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:32,855 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/4cd11160b93d4da496246c52500bae13, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/447db08b0038441cabf0f75f6d664d32, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/3df2ee9c2cd34e5d8e5bd39df87f62ff, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/335adce7240c461ea82fa81aa12789da, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/3d622f84845a4d3a9d063d92dc931cf2, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/ab450db5543d455d876ad2364eac45b4, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/6c3eded2483b44dd92605e1540575a57, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/f9d7d42931484b92b33d015fd8cdf0fc, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/9a98ff35525b43ff9bcaeed4489b335f, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/ca389fd0a3634085b1f83441069a445f_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp, totalSize=50.4 K 2023-02-08 02:56:32,855 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 4cd11160b93d4da496246c52500bae13, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-08 02:56:32,856 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 447db08b0038441cabf0f75f6d664d32, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-08 02:56:32,856 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 3df2ee9c2cd34e5d8e5bd39df87f62ff, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-08 02:56:32,856 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 335adce7240c461ea82fa81aa12789da, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-08 02:56:32,856 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 3d622f84845a4d3a9d063d92dc931cf2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-08 02:56:32,856 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting ab450db5543d455d876ad2364eac45b4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-08 02:56:32,856 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 6c3eded2483b44dd92605e1540575a57, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-08 02:56:32,856 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting f9d7d42931484b92b33d015fd8cdf0fc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-08 02:56:32,856 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 9a98ff35525b43ff9bcaeed4489b335f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-08 02:56:32,856 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting ca389fd0a3634085b1f83441069a445f_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-08 02:56:32,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 02:56:32,858 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:56:32,859 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228066407ac8e8d46a8bc208a9f0f97535d to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228066407ac8e8d46a8bc208a9f0f97535d 2023-02-08 02:56:32,860 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231ad3370a6017c405aaf5f32ac671eda97 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231ad3370a6017c405aaf5f32ac671eda97 2023-02-08 02:56:32,861 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601018047720983a84090a0d5d467bc770c0d to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601018047720983a84090a0d5d467bc770c0d 2023-02-08 02:56:32,863 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601030a4bb87b260843cfbd23187f8c09d20f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601030a4bb87b260843cfbd23187f8c09d20f 2023-02-08 02:56:32,863 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-02-08 02:56:32,863 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-08 02:56:32,864 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:32,864 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:32,864 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:32,864 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:32,864 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:32,864 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:32,864 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:32,864 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:32,896 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] throttle.PressureAwareThroughputController(145): db39cc04ed2076379d0004c2e09c0e42#family1#compaction#61 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-08 02:56:33,325 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp/family1/746b1486d39043829842e9e64d407761 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/746b1486d39043829842e9e64d407761 2023-02-08 02:56:33,326 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b322a27e1a14454fb9184ede13d77db7 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205b322a27e1a14454fb9184ede13d77db7 2023-02-08 02:56:33,327 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 02:56:33,331 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in db39cc04ed2076379d0004c2e09c0e42/family1 of db39cc04ed2076379d0004c2e09c0e42 into 746b1486d39043829842e9e64d407761(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 02:56:33,331 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for db39cc04ed2076379d0004c2e09c0e42: 2023-02-08 02:56:33,331 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1675824992855; duration=0sec 2023-02-08 02:56:33,331 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:56:33,345 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:33,345 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:33,359 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4e0383256d3d486eabcc60db9be598b5 first=Optional[r00] last=Optional[r2] 2023-02-08 02:56:33,360 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4e0383256d3d486eabcc60db9be598b5}] 2023-02-08 02:56:33,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4e0383256d3d486eabcc60db9be598b5 for inclusion in db39cc04ed2076379d0004c2e09c0e42/family1 2023-02-08 02:56:33,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-08 02:56:33,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 02:56:33,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for db39cc04ed2076379d0004c2e09c0e42: 2023-02-08 02:56:33,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4e0383256d3d486eabcc60db9be598b5 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hefpqjfv0uf4355iidi5j9dhvetmjjd9ju5ilcvoqps1jmaolahimbj84v1rc73i/family1/4e0383256d3d486eabcc60db9be598b5 2023-02-08 02:56:33,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hefpqjfv0uf4355iidi5j9dhvetmjjd9ju5ilcvoqps1jmaolahimbj84v1rc73i/family1/4e0383256d3d486eabcc60db9be598b5 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/d9d4f0cb7453458785cfcf0998582c2b_SeqId_47_ 2023-02-08 02:56:33,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hefpqjfv0uf4355iidi5j9dhvetmjjd9ju5ilcvoqps1jmaolahimbj84v1rc73i/family1/4e0383256d3d486eabcc60db9be598b5 into db39cc04ed2076379d0004c2e09c0e42/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/d9d4f0cb7453458785cfcf0998582c2b_SeqId_47_ - updating store file list. 2023-02-08 02:56:33,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/d9d4f0cb7453458785cfcf0998582c2b_SeqId_47_ into db39cc04ed2076379d0004c2e09c0e42/family1 2023-02-08 02:56:33,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hefpqjfv0uf4355iidi5j9dhvetmjjd9ju5ilcvoqps1jmaolahimbj84v1rc73i/family1/4e0383256d3d486eabcc60db9be598b5 into db39cc04ed2076379d0004c2e09c0e42/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/d9d4f0cb7453458785cfcf0998582c2b_SeqId_47_) 2023-02-08 02:56:33,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hefpqjfv0uf4355iidi5j9dhvetmjjd9ju5ilcvoqps1jmaolahimbj84v1rc73i/family1/4e0383256d3d486eabcc60db9be598b5 2023-02-08 02:56:33,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-08 02:56:33,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-08 02:56:33,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(1912): db39cc04ed2076379d0004c2e09c0e42/family1 is initiating minor compaction (all files) 2023-02-08 02:56:33,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7426c167; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:56:33,376 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of db39cc04ed2076379d0004c2e09c0e42/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:33,376 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/cdea468b0153417caae6389ac1382bca, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/746b1486d39043829842e9e64d407761, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/d9d4f0cb7453458785cfcf0998582c2b_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp, totalSize=390.1 K 2023-02-08 02:56:33,377 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting cdea468b0153417caae6389ac1382bca, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878815769 2023-02-08 02:56:33,377 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 746b1486d39043829842e9e64d407761, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621215769 2023-02-08 02:56:33,378 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting d9d4f0cb7453458785cfcf0998582c2b_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878815769 2023-02-08 02:56:33,378 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 02:56:33,381 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:56:33,383 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113067df4b40c021470fb14e581816945bc5 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113067df4b40c021470fb14e581816945bc5 2023-02-08 02:56:33,384 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201ff2bc2871c054d24a91fdc5a7148826a to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201ff2bc2871c054d24a91fdc5a7148826a 2023-02-08 02:56:33,385 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120502f13f5eb45b414c85a0e60ffb63d3c3 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120502f13f5eb45b414c85a0e60ffb63d3c3 2023-02-08 02:56:33,385 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-02-08 02:56:33,385 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-08 02:56:33,386 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:33,386 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 02:56:33,386 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:56:33,387 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-08 02:56:33,388 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.4700 sec 2023-02-08 02:56:33,397 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] throttle.PressureAwareThroughputController(145): db39cc04ed2076379d0004c2e09c0e42#family1#compaction#62 average throughput is 25.80 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-08 02:56:33,421 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/4cd11160b93d4da496246c52500bae13, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/447db08b0038441cabf0f75f6d664d32, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/3df2ee9c2cd34e5d8e5bd39df87f62ff, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/335adce7240c461ea82fa81aa12789da, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/3d622f84845a4d3a9d063d92dc931cf2, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/ab450db5543d455d876ad2364eac45b4, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/6c3eded2483b44dd92605e1540575a57, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/f9d7d42931484b92b33d015fd8cdf0fc, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/9a98ff35525b43ff9bcaeed4489b335f, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/ca389fd0a3634085b1f83441069a445f_SeqId_44_] to archive 2023-02-08 02:56:33,422 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:56:33,423 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/4cd11160b93d4da496246c52500bae13 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/4cd11160b93d4da496246c52500bae13 2023-02-08 02:56:33,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/447db08b0038441cabf0f75f6d664d32 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/447db08b0038441cabf0f75f6d664d32 2023-02-08 02:56:33,426 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/3df2ee9c2cd34e5d8e5bd39df87f62ff to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/3df2ee9c2cd34e5d8e5bd39df87f62ff 2023-02-08 02:56:33,427 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/335adce7240c461ea82fa81aa12789da to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/335adce7240c461ea82fa81aa12789da 2023-02-08 02:56:33,428 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/3d622f84845a4d3a9d063d92dc931cf2 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/3d622f84845a4d3a9d063d92dc931cf2 2023-02-08 02:56:33,429 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/ab450db5543d455d876ad2364eac45b4 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/ab450db5543d455d876ad2364eac45b4 2023-02-08 02:56:33,430 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/6c3eded2483b44dd92605e1540575a57 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/6c3eded2483b44dd92605e1540575a57 2023-02-08 02:56:33,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/f9d7d42931484b92b33d015fd8cdf0fc to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/f9d7d42931484b92b33d015fd8cdf0fc 2023-02-08 02:56:33,433 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/9a98ff35525b43ff9bcaeed4489b335f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/9a98ff35525b43ff9bcaeed4489b335f 2023-02-08 02:56:33,434 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/ca389fd0a3634085b1f83441069a445f_SeqId_44_ to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/ca389fd0a3634085b1f83441069a445f_SeqId_44_ 2023-02-08 02:56:33,460 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:33,460 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:33,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.HMaster$12(2441): Client=jenkins//136.243.104.168 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-08 02:56:33,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:33,873 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-08 02:56:33,875 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-08 02:56:33,876 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-08 02:56:33,880 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-08 02:56:33,884 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=db39cc04ed2076379d0004c2e09c0e42, REOPEN/MOVE}] 2023-02-08 02:56:33,885 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=db39cc04ed2076379d0004c2e09c0e42, REOPEN/MOVE 2023-02-08 02:56:33,886 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=db39cc04ed2076379d0004c2e09c0e42, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:33,886 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675824993886"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675824993886"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675824993886"}]},"ts":"1675824993886"} 2023-02-08 02:56:33,887 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure db39cc04ed2076379d0004c2e09c0e42, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:56:34,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:34,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing db39cc04ed2076379d0004c2e09c0e42, disabling compactions & flushes 2023-02-08 02:56:34,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:34,237 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/.tmp/family1/6fc68c7fc1ff46bea0eda0dfe72bd858 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/6fc68c7fc1ff46bea0eda0dfe72bd858 2023-02-08 02:56:34,242 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in db39cc04ed2076379d0004c2e09c0e42/family1 of db39cc04ed2076379d0004c2e09c0e42 into 6fc68c7fc1ff46bea0eda0dfe72bd858(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 02:56:34,242 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for db39cc04ed2076379d0004c2e09c0e42: 2023-02-08 02:56:34,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:34,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:34,242 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1675824993376; duration=0sec 2023-02-08 02:56:34,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. after waiting 0 ms 2023-02-08 02:56:34,242 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:56:34,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:34,243 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/cdea468b0153417caae6389ac1382bca, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/746b1486d39043829842e9e64d407761, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/d9d4f0cb7453458785cfcf0998582c2b_SeqId_47_] to archive 2023-02-08 02:56:34,243 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:56:34,245 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/cdea468b0153417caae6389ac1382bca to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/cdea468b0153417caae6389ac1382bca 2023-02-08 02:56:34,246 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/746b1486d39043829842e9e64d407761 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/746b1486d39043829842e9e64d407761 2023-02-08 02:56:34,247 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/d9d4f0cb7453458785cfcf0998582c2b_SeqId_47_ to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/d9d4f0cb7453458785cfcf0998582c2b_SeqId_47_ 2023-02-08 02:56:34,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-08 02:56:34,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:34,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for db39cc04ed2076379d0004c2e09c0e42: Waiting for close lock at 1675824994041Running coprocessor pre-close hooks at 1675824994041Disabling compacts and flushes for region at 1675824994041Disabling writes for close at 1675824994242 (+201 ms)Writing region close event to WAL at 1675824994249 (+7 ms)Running coprocessor post-close hooks at 1675824994252 (+3 ms)Closed at 1675824994252 2023-02-08 02:56:34,252 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(3509): Not adding moved region record: db39cc04ed2076379d0004c2e09c0e42 to self. 2023-02-08 02:56:34,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:34,254 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=db39cc04ed2076379d0004c2e09c0e42, regionState=CLOSED 2023-02-08 02:56:34,254 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675824994254"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675824994254"}]},"ts":"1675824994254"} 2023-02-08 02:56:34,256 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-02-08 02:56:34,256 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure db39cc04ed2076379d0004c2e09c0e42, server=jenkins-hbase12.apache.org,44577,1675824910652 in 368 msec 2023-02-08 02:56:34,256 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=db39cc04ed2076379d0004c2e09c0e42, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=true 2023-02-08 02:56:34,407 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=db39cc04ed2076379d0004c2e09c0e42, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:34,407 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675824994407"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675824994407"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675824994407"}]},"ts":"1675824994407"} 2023-02-08 02:56:34,410 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure db39cc04ed2076379d0004c2e09c0e42, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:56:34,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:34,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => db39cc04ed2076379d0004c2e09c0e42, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.', STARTKEY => '', ENDKEY => ''} 2023-02-08 02:56:34,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:34,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:56:34,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:34,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:34,574 INFO [StoreOpener-db39cc04ed2076379d0004c2e09c0e42-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:34,576 DEBUG [StoreOpener-db39cc04ed2076379d0004c2e09c0e42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1 2023-02-08 02:56:34,576 DEBUG [StoreOpener-db39cc04ed2076379d0004c2e09c0e42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1 2023-02-08 02:56:34,577 INFO [StoreOpener-db39cc04ed2076379d0004c2e09c0e42-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db39cc04ed2076379d0004c2e09c0e42 columnFamilyName family1 2023-02-08 02:56:34,586 DEBUG [StoreOpener-db39cc04ed2076379d0004c2e09c0e42-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/6fc68c7fc1ff46bea0eda0dfe72bd858 2023-02-08 02:56:34,587 INFO [StoreOpener-db39cc04ed2076379d0004c2e09c0e42-1] regionserver.HStore(310): Store=db39cc04ed2076379d0004c2e09c0e42/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:56:34,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:34,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:34,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:34,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened db39cc04ed2076379d0004c2e09c0e42; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59249455, jitterRate=-0.11711432039737701}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 02:56:34,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for db39cc04ed2076379d0004c2e09c0e42: Running coprocessor pre-open hook at 1675824994572Writing region info on filesystem at 1675824994572Initializing all the Stores at 1675824994574 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675824994574Cleaning up temporary data from old regions at 1675824994590 (+16 ms)Cleaning up detritus from prior splits at 1675824994590Running coprocessor post-open hooks at 1675824994593 (+3 ms)Region opened successfully at 1675824994593 2023-02-08 02:56:34,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42., pid=47, masterSystemTime=1675824994562 2023-02-08 02:56:34,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:34,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:34,595 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=db39cc04ed2076379d0004c2e09c0e42, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:34,595 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675824994595"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675824994595"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675824994595"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675824994595"}]},"ts":"1675824994595"} 2023-02-08 02:56:34,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-02-08 02:56:34,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure db39cc04ed2076379d0004c2e09c0e42, server=jenkins-hbase12.apache.org,44577,1675824910652 in 188 msec 2023-02-08 02:56:34,600 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-02-08 02:56:34,600 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=db39cc04ed2076379d0004c2e09c0e42, REOPEN/MOVE in 714 msec 2023-02-08 02:56:34,601 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-08 02:56:34,601 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 720 msec 2023-02-08 02:56:34,603 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1410 sec 2023-02-08 02:56:34,603 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:34,603 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:34,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-02-08 02:56:34,604 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:34,604 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:34,605 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:34,605 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:34,606 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(278): alter status finished 2023-02-08 02:56:34,607 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:34,608 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-08 02:56:34,609 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-08 02:56:34,609 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675825594609 2023-02-08 02:56:34,609 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:56:34,610 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 02:56:34,611 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-08 02:56:34,611 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 02:56:34,611 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] zookeeper.ReadOnlyZKClient(139): Connect 0x5c8a2ca7 to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:56:34,688 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@478028f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:56:34,688 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:34,689 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:34,689 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:34,689 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:34,689 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:35,524 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282ed5c61a1e2646f7b9c9f2d406386bd8 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511282ed5c61a1e2646f7b9c9f2d406386bd8 2023-02-08 02:56:35,525 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 02:56:35,536 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 02:56:35,537 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:52646, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 02:56:35,543 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:35,543 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:35,544 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 02:56:35,546 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:36254, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 02:56:35,555 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/db34431e0e824b67b504a39bd9695bc6 first=Optional[r05] last=Optional[r8] 2023-02-08 02:56:35,555 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/db34431e0e824b67b504a39bd9695bc6}] 2023-02-08 02:56:35,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/db34431e0e824b67b504a39bd9695bc6 for inclusion in db39cc04ed2076379d0004c2e09c0e42/family1 2023-02-08 02:56:35,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-08 02:56:35,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 02:56:35,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for db39cc04ed2076379d0004c2e09c0e42: 2023-02-08 02:56:35,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/db34431e0e824b67b504a39bd9695bc6 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ls1j4cvg2le2ebfv88b6moiitjr5hdlipq3rls5dhvdb3j180n6vv57eakk649q5/family1/db34431e0e824b67b504a39bd9695bc6 2023-02-08 02:56:35,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ls1j4cvg2le2ebfv88b6moiitjr5hdlipq3rls5dhvdb3j180n6vv57eakk649q5/family1/db34431e0e824b67b504a39bd9695bc6 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/03c7d438eb9a41d6b0d753a078578345_SeqId_53_ 2023-02-08 02:56:35,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ls1j4cvg2le2ebfv88b6moiitjr5hdlipq3rls5dhvdb3j180n6vv57eakk649q5/family1/db34431e0e824b67b504a39bd9695bc6 into db39cc04ed2076379d0004c2e09c0e42/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/03c7d438eb9a41d6b0d753a078578345_SeqId_53_ - updating store file list. 2023-02-08 02:56:35,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/03c7d438eb9a41d6b0d753a078578345_SeqId_53_ into db39cc04ed2076379d0004c2e09c0e42/family1 2023-02-08 02:56:35,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ls1j4cvg2le2ebfv88b6moiitjr5hdlipq3rls5dhvdb3j180n6vv57eakk649q5/family1/db34431e0e824b67b504a39bd9695bc6 into db39cc04ed2076379d0004c2e09c0e42/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/03c7d438eb9a41d6b0d753a078578345_SeqId_53_) 2023-02-08 02:56:35,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ls1j4cvg2le2ebfv88b6moiitjr5hdlipq3rls5dhvdb3j180n6vv57eakk649q5/family1/db34431e0e824b67b504a39bd9695bc6 2023-02-08 02:56:35,574 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 02:56:35,575 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:56:35,576 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112052de392247744048a060d53c4ad00a00 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112052de392247744048a060d53c4ad00a00 2023-02-08 02:56:35,577 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112858c2b442826c494faa565ea7ce6ee9f1 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112858c2b442826c494faa565ea7ce6ee9f1 2023-02-08 02:56:35,577 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-02-08 02:56:35,577 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-08 02:56:35,577 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:35,577 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:35,577 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:35,578 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 02:56:35,578 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:56:35,578 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-08 02:56:35,579 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 971 msec 2023-02-08 02:56:35,639 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:35,639 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:35,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.HMaster$12(2441): Client=jenkins//136.243.104.168 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-08 02:56:35,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:36,051 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-08 02:56:36,053 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-08 02:56:36,054 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-08 02:56:36,158 INFO [AsyncFSWAL-0-hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/MasterData-prefix:jenkins-hbase12.apache.org,43477,1675824909306] wal.AbstractFSWAL(1045): Slow sync cost: 103 ms, current pipeline: [DatanodeInfoWithStorage[127.0.0.1:33321,DS-923c4f97-702d-4d66-8ed8-095acac1aa38,DISK]] 2023-02-08 02:56:36,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-08 02:56:36,167 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=db39cc04ed2076379d0004c2e09c0e42, REOPEN/MOVE}] 2023-02-08 02:56:36,169 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=db39cc04ed2076379d0004c2e09c0e42, REOPEN/MOVE 2023-02-08 02:56:36,170 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=db39cc04ed2076379d0004c2e09c0e42, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:36,170 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675824996170"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675824996170"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675824996170"}]},"ts":"1675824996170"} 2023-02-08 02:56:36,172 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure db39cc04ed2076379d0004c2e09c0e42, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:56:36,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:36,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing db39cc04ed2076379d0004c2e09c0e42, disabling compactions & flushes 2023-02-08 02:56:36,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:36,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:36,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. after waiting 0 ms 2023-02-08 02:56:36,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:36,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-08 02:56:36,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:36,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for db39cc04ed2076379d0004c2e09c0e42: Waiting for close lock at 1675824996324Running coprocessor pre-close hooks at 1675824996324Disabling compacts and flushes for region at 1675824996324Disabling writes for close at 1675824996324Writing region close event to WAL at 1675824996328 (+4 ms)Running coprocessor post-close hooks at 1675824996334 (+6 ms)Closed at 1675824996334 2023-02-08 02:56:36,335 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(3509): Not adding moved region record: db39cc04ed2076379d0004c2e09c0e42 to self. 2023-02-08 02:56:36,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:36,337 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=db39cc04ed2076379d0004c2e09c0e42, regionState=CLOSED 2023-02-08 02:56:36,337 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675824996337"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675824996337"}]},"ts":"1675824996337"} 2023-02-08 02:56:36,342 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-02-08 02:56:36,342 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure db39cc04ed2076379d0004c2e09c0e42, server=jenkins-hbase12.apache.org,44577,1675824910652 in 167 msec 2023-02-08 02:56:36,343 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=db39cc04ed2076379d0004c2e09c0e42, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=true 2023-02-08 02:56:36,493 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=db39cc04ed2076379d0004c2e09c0e42, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:36,493 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675824996493"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675824996493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675824996493"}]},"ts":"1675824996493"} 2023-02-08 02:56:36,495 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure db39cc04ed2076379d0004c2e09c0e42, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:56:36,656 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:36,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => db39cc04ed2076379d0004c2e09c0e42, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.', STARTKEY => '', ENDKEY => ''} 2023-02-08 02:56:36,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:36,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:56:36,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:36,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:36,660 INFO [StoreOpener-db39cc04ed2076379d0004c2e09c0e42-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:36,663 DEBUG [StoreOpener-db39cc04ed2076379d0004c2e09c0e42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1 2023-02-08 02:56:36,663 DEBUG [StoreOpener-db39cc04ed2076379d0004c2e09c0e42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1 2023-02-08 02:56:36,663 INFO [StoreOpener-db39cc04ed2076379d0004c2e09c0e42-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db39cc04ed2076379d0004c2e09c0e42 columnFamilyName family1 2023-02-08 02:56:36,673 DEBUG [StoreOpener-db39cc04ed2076379d0004c2e09c0e42-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/03c7d438eb9a41d6b0d753a078578345_SeqId_53_ 2023-02-08 02:56:36,678 DEBUG [StoreOpener-db39cc04ed2076379d0004c2e09c0e42-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/family1/6fc68c7fc1ff46bea0eda0dfe72bd858 2023-02-08 02:56:36,678 INFO [StoreOpener-db39cc04ed2076379d0004c2e09c0e42-1] regionserver.HStore(310): Store=db39cc04ed2076379d0004c2e09c0e42/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:56:36,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:36,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:36,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:56:36,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened db39cc04ed2076379d0004c2e09c0e42; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72754049, jitterRate=0.08411981165409088}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 02:56:36,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for db39cc04ed2076379d0004c2e09c0e42: Running coprocessor pre-open hook at 1675824996658Writing region info on filesystem at 1675824996658Initializing all the Stores at 1675824996660 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675824996660Cleaning up temporary data from old regions at 1675824996682 (+22 ms)Cleaning up detritus from prior splits at 1675824996682Running coprocessor post-open hooks at 1675824996685 (+3 ms)Region opened successfully at 1675824996685 2023-02-08 02:56:36,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42., pid=53, masterSystemTime=1675824996648 2023-02-08 02:56:36,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:36,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:56:36,687 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=db39cc04ed2076379d0004c2e09c0e42, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:36,687 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675824996687"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675824996687"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675824996687"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675824996687"}]},"ts":"1675824996687"} 2023-02-08 02:56:36,690 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-02-08 02:56:36,690 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure db39cc04ed2076379d0004c2e09c0e42, server=jenkins-hbase12.apache.org,44577,1675824910652 in 194 msec 2023-02-08 02:56:36,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-02-08 02:56:36,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=db39cc04ed2076379d0004c2e09c0e42, REOPEN/MOVE in 523 msec 2023-02-08 02:56:36,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-02-08 02:56:36,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 531 msec 2023-02-08 02:56:36,695 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0530 sec 2023-02-08 02:56:36,695 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:36,695 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:36,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-02-08 02:56:36,696 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:36,696 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:36,696 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:36,696 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:36,697 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(278): alter status finished 2023-02-08 02:56:36,698 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 02:56:36,699 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-08 02:56:36,700 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-08 02:56:36,700 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675825596700 2023-02-08 02:56:36,700 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:56:36,701 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 02:56:36,701 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-08 02:56:36,701 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 02:56:36,702 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] zookeeper.ReadOnlyZKClient(139): Connect 0x3ec3e51c to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:56:36,751 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7842a5b1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:56:36,751 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:36,751 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:36,751 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:36,751 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:36,751 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:36,751 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:36,751 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:36,751 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 02:56:36,751 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 02:56:36,752 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:56:36,753 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-08 02:56:36,755 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 55 msec 2023-02-08 02:56:36,813 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=240 (was 249), OpenFileDescriptor=608 (was 604) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=154 (was 179), ProcessCount=176 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=3421 (was 3644) 2023-02-08 02:56:36,822 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=240, OpenFileDescriptor=608, MaxFileDescriptor=60000, SystemLoadAverage=154, ProcessCount=176, AvailableMemoryMB=3421 2023-02-08 02:56:36,823 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:36,823 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:36,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-08 02:56:36,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:36,826 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 02:56:36,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-02-08 02:56:36,826 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:36,826 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:36,826 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 02:56:36,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-08 02:56:36,827 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:36,828 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e empty. 2023-02-08 02:56:36,828 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:36,828 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-02-08 02:56:36,927 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:36,927 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:36,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-08 02:56:37,128 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:37,128 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:37,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-08 02:56:37,237 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-08 02:56:37,239 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7671): creating {ENCODED => 12c23930d7c44fc1708b711f7de5640e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp 2023-02-08 02:56:37,430 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:37,430 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:37,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-08 02:56:37,649 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:56:37,649 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1603): Closing 12c23930d7c44fc1708b711f7de5640e, disabling compactions & flushes 2023-02-08 02:56:37,649 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:37,649 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:37,649 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. after waiting 0 ms 2023-02-08 02:56:37,649 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:37,649 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:37,649 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1557): Region close journal for 12c23930d7c44fc1708b711f7de5640e: Waiting for close lock at 1675824997649Disabling compacts and flushes for region at 1675824997649Disabling writes for close at 1675824997649Writing region close event to WAL at 1675824997649Closed at 1675824997649 2023-02-08 02:56:37,652 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 02:56:37,652 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675824997652"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675824997652"}]},"ts":"1675824997652"} 2023-02-08 02:56:37,654 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 02:56:37,655 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 02:56:37,655 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675824997655"}]},"ts":"1675824997655"} 2023-02-08 02:56:37,656 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-02-08 02:56:37,729 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=12c23930d7c44fc1708b711f7de5640e, ASSIGN}] 2023-02-08 02:56:37,732 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=12c23930d7c44fc1708b711f7de5640e, ASSIGN 2023-02-08 02:56:37,734 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=12c23930d7c44fc1708b711f7de5640e, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=false 2023-02-08 02:56:37,886 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=12c23930d7c44fc1708b711f7de5640e, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:37,886 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675824997886"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675824997886"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675824997886"}]},"ts":"1675824997886"} 2023-02-08 02:56:37,890 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 12c23930d7c44fc1708b711f7de5640e, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:56:37,931 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:37,932 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:37,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-08 02:56:38,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:38,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 12c23930d7c44fc1708b711f7de5640e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.', STARTKEY => '', ENDKEY => ''} 2023-02-08 02:56:38,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:38,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:56:38,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:38,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:38,054 INFO [StoreOpener-12c23930d7c44fc1708b711f7de5640e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:38,057 DEBUG [StoreOpener-12c23930d7c44fc1708b711f7de5640e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1 2023-02-08 02:56:38,057 DEBUG [StoreOpener-12c23930d7c44fc1708b711f7de5640e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1 2023-02-08 02:56:38,057 INFO [StoreOpener-12c23930d7c44fc1708b711f7de5640e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12c23930d7c44fc1708b711f7de5640e columnFamilyName family1 2023-02-08 02:56:38,060 INFO [StoreOpener-12c23930d7c44fc1708b711f7de5640e-1] regionserver.HStore(310): Store=12c23930d7c44fc1708b711f7de5640e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:56:38,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:38,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:38,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:38,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:56:38,071 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 12c23930d7c44fc1708b711f7de5640e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61028339, jitterRate=-0.09060688316822052}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 02:56:38,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 12c23930d7c44fc1708b711f7de5640e: Running coprocessor pre-open hook at 1675824998052Writing region info on filesystem at 1675824998052Initializing all the Stores at 1675824998054 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675824998054Cleaning up temporary data from old regions at 1675824998063 (+9 ms)Cleaning up detritus from prior splits at 1675824998064 (+1 ms)Running coprocessor post-open hooks at 1675824998071 (+7 ms)Region opened successfully at 1675824998071 2023-02-08 02:56:38,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e., pid=57, masterSystemTime=1675824998043 2023-02-08 02:56:38,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:38,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:38,074 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=12c23930d7c44fc1708b711f7de5640e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:38,074 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675824998074"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675824998074"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675824998074"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675824998074"}]},"ts":"1675824998074"} 2023-02-08 02:56:38,077 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-02-08 02:56:38,077 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 12c23930d7c44fc1708b711f7de5640e, server=jenkins-hbase12.apache.org,44577,1675824910652 in 185 msec 2023-02-08 02:56:38,079 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-02-08 02:56:38,079 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=12c23930d7c44fc1708b711f7de5640e, ASSIGN in 348 msec 2023-02-08 02:56:38,079 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 02:56:38,079 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675824998079"}]},"ts":"1675824998079"} 2023-02-08 02:56:38,081 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-02-08 02:56:38,129 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 02:56:38,130 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.3050 sec 2023-02-08 02:56:38,934 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:38,934 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:38,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-08 02:56:38,937 INFO [Listener at localhost.localdomain/44017] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-02-08 02:56:38,961 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:38,961 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:38,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:38,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:38,963 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 02:56:38,963 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:38,963 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-08 02:56:38,963 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-08 02:56:38,963 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:38,963 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:39,023 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:39,023 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:39,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:39,024 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:39,024 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:39,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:39,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:39,025 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:39,025 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:39,025 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-08 02:56:39,025 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:39,026 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-08 02:56:39,026 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:39,026 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:39,026 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:39,026 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. started... 2023-02-08 02:56:39,027 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 12c23930d7c44fc1708b711f7de5640e 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-08 02:56:39,451 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113026f4bb1b5c5a47c69759df613573e0b6 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113026f4bb1b5c5a47c69759df613573e0b6 2023-02-08 02:56:39,787 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 02:56:39,855 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp/family1/4332733dd18b4896b90883e7d1bdfd03 2023-02-08 02:56:39,860 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp/family1/4332733dd18b4896b90883e7d1bdfd03 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/4332733dd18b4896b90883e7d1bdfd03 2023-02-08 02:56:39,864 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/4332733dd18b4896b90883e7d1bdfd03, entries=1000, sequenceid=5, filesize=190.5 K 2023-02-08 02:56:39,865 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 12c23930d7c44fc1708b711f7de5640e in 838ms, sequenceid=5, compaction requested=false 2023-02-08 02:56:39,866 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 02:56:39,866 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 12c23930d7c44fc1708b711f7de5640e: 2023-02-08 02:56:39,866 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:39,866 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:39,866 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:39,866 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:39,866 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-08 02:56:39,866 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-08 02:56:39,960 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:39,960 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:39,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:39,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:39,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:39,961 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:39,961 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:39,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:39,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:39,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:39,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:39,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:39,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-08 02:56:39,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fcde45a[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:39,967 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-08 02:56:39,967 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:39,971 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:39,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:39,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:39,971 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-08 02:56:39,971 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-08 02:56:39,971 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:39,972 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:39,972 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:39,981 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:39,981 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-08 02:56:39,982 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:39,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:39,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:39,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:39,982 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-08 02:56:39,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:39,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:39,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:39,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:39,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:39,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:39,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:39,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:39,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-08 02:56:39,990 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-08 02:56:39,991 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:39,991 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:39,991 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:39,991 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:40,002 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:40,002 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:40,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:40,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:40,002 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:40,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:40,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:40,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:40,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:40,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:40,003 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:40,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:40,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:40,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:40,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:40,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:40,005 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:40,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:40,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:40,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:40,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:40,040 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:40,040 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:40,041 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:40,041 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:40,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:40,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:40,041 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:40,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 02:56:40,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:40,041 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:40,041 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:40,042 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:40,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:40,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:40,042 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-08 02:56:40,042 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:40,042 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:40,043 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:40,043 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:40,144 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:40,144 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:40,144 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:40,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:40,148 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:40,148 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:40,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:40,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:40,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:40,150 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 02:56:40,150 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:40,150 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-08 02:56:40,150 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-08 02:56:40,151 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:40,151 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:40,171 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:40,171 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:40,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:40,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:40,171 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:40,171 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:40,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:40,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:40,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:40,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:40,173 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:40,173 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-08 02:56:40,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:40,173 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-08 02:56:40,173 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:40,173 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-08 02:56:40,174 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:40,174 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:40,174 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:40,174 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. started... 2023-02-08 02:56:40,174 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 12c23930d7c44fc1708b711f7de5640e 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-08 02:56:40,598 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112862b5415bed654ba3b35cc85ca664afa7 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112862b5415bed654ba3b35cc85ca664afa7 2023-02-08 02:56:41,004 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp/family1/ccc1b040ae0c4654b3ec2839c43e0c09 2023-02-08 02:56:41,010 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp/family1/ccc1b040ae0c4654b3ec2839c43e0c09 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/ccc1b040ae0c4654b3ec2839c43e0c09 2023-02-08 02:56:41,016 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/ccc1b040ae0c4654b3ec2839c43e0c09, entries=1, sequenceid=9, filesize=5.0 K 2023-02-08 02:56:41,017 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 12c23930d7c44fc1708b711f7de5640e in 843ms, sequenceid=9, compaction requested=false 2023-02-08 02:56:41,017 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 12c23930d7c44fc1708b711f7de5640e: 2023-02-08 02:56:41,017 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:41,017 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:41,017 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:41,017 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:41,017 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-08 02:56:41,017 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-08 02:56:41,097 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:41,097 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:41,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:41,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:41,098 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,099 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:41,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:41,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:41,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:41,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:41,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-08 02:56:41,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3277d4b6[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:41,104 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-08 02:56:41,104 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,117 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,118 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-08 02:56:41,118 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-08 02:56:41,118 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:41,118 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:41,118 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:41,129 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-08 02:56:41,129 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:41,129 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-08 02:56:41,129 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:41,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:41,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:41,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:41,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:41,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:41,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:41,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:41,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:41,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:41,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-08 02:56:41,138 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-08 02:56:41,138 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:41,138 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:41,138 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,139 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:41,150 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,150 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,150 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:41,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:41,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:41,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:41,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:41,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:41,152 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:41,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:41,155 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:41,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:41,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:41,170 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:41,170 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:41,170 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:41,170 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,171 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:41,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-08 02:56:41,171 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,171 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:41,171 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 02:56:41,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:41,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:41,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:41,171 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,171 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,171 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:41,171 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:41,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:41,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:41,271 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:41,272 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:41,272 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:41,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:41,282 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:41,282 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:41,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:41,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:41,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,286 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 02:56:41,286 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:41,287 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-08 02:56:41,287 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-08 02:56:41,287 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,288 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,297 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:41,297 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:41,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:41,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:41,298 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:41,298 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:41,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,300 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:41,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,301 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,302 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-08 02:56:41,302 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:41,302 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-08 02:56:41,302 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:41,303 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-08 02:56:41,303 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:41,303 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:41,303 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:41,303 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. started... 2023-02-08 02:56:41,303 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 12c23930d7c44fc1708b711f7de5640e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:41,723 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201f7a014956f644595a151bae566bc9b44 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201f7a014956f644595a151bae566bc9b44 2023-02-08 02:56:42,130 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp/family1/842052b569d240a586b0ebe6d218b071 2023-02-08 02:56:42,140 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp/family1/842052b569d240a586b0ebe6d218b071 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/842052b569d240a586b0ebe6d218b071 2023-02-08 02:56:42,146 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/842052b569d240a586b0ebe6d218b071, entries=1, sequenceid=13, filesize=5.0 K 2023-02-08 02:56:42,147 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 12c23930d7c44fc1708b711f7de5640e in 844ms, sequenceid=13, compaction requested=true 2023-02-08 02:56:42,148 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 12c23930d7c44fc1708b711f7de5640e: 2023-02-08 02:56:42,148 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:42,148 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:42,148 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:42,148 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:42,148 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-08 02:56:42,148 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-08 02:56:42,202 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,202 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:42,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:42,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:42,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:42,203 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,203 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:42,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:42,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:42,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:42,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:42,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-08 02:56:42,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b503812[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:42,208 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-08 02:56:42,208 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,213 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,213 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-08 02:56:42,213 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-08 02:56:42,213 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:42,213 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:42,214 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:42,223 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-08 02:56:42,223 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:42,223 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:42,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:42,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:42,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:42,224 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-08 02:56:42,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:42,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:42,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:42,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:42,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:42,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-08 02:56:42,233 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-08 02:56:42,234 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:42,234 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:42,234 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,234 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:42,244 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,244 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,244 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:42,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:42,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:42,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:42,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:42,246 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:42,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:42,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:42,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,248 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:42,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:42,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:42,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:42,255 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:42,255 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:42,255 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:42,255 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,255 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:42,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:42,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:42,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 02:56:42,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:42,255 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,256 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:42,256 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,256 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,256 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,256 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:42,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-08 02:56:42,256 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:42,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:42,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:42,356 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:42,357 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:42,357 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:42,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:42,368 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:42,368 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:42,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:42,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:42,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,372 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 02:56:42,372 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:42,372 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-08 02:56:42,372 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-08 02:56:42,372 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,373 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,381 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:42,381 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:42,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:42,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:42,381 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:42,381 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:42,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,382 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:42,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,382 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,382 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-08 02:56:42,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:42,382 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-08 02:56:42,383 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:42,383 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-08 02:56:42,383 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:42,383 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:42,383 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:42,383 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. started... 2023-02-08 02:56:42,383 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 12c23930d7c44fc1708b711f7de5640e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:42,795 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512057ff64c2ce93f45e09ac560b0626dbc24 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512057ff64c2ce93f45e09ac560b0626dbc24 2023-02-08 02:56:43,201 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp/family1/562ac8b635834c7aaeab5fb85a9eb466 2023-02-08 02:56:43,213 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp/family1/562ac8b635834c7aaeab5fb85a9eb466 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/562ac8b635834c7aaeab5fb85a9eb466 2023-02-08 02:56:43,219 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/562ac8b635834c7aaeab5fb85a9eb466, entries=1, sequenceid=17, filesize=5.0 K 2023-02-08 02:56:43,220 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 12c23930d7c44fc1708b711f7de5640e in 837ms, sequenceid=17, compaction requested=true 2023-02-08 02:56:43,220 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 12c23930d7c44fc1708b711f7de5640e: 2023-02-08 02:56:43,220 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:43,221 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:43,221 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:43,221 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:43,221 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-08 02:56:43,221 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-08 02:56:43,315 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:43,315 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:43,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:43,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:43,316 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,316 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:43,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:43,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:43,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:43,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:43,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-08 02:56:43,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46c28a06[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:43,322 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-08 02:56:43,322 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,339 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,340 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-08 02:56:43,340 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-08 02:56:43,340 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:43,340 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:43,340 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:43,350 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-08 02:56:43,350 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:43,350 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:43,350 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-08 02:56:43,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:43,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:43,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:43,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:43,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:43,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:43,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:43,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:43,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:43,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-08 02:56:43,361 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-08 02:56:43,361 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:43,361 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:43,361 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,361 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:43,370 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,370 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:43,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:43,370 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:43,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:43,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:43,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:43,371 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:43,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:43,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:43,374 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:43,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:43,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:43,381 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:43,381 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:43,381 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:43,381 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,381 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:43,381 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-08 02:56:43,381 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,381 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:43,381 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,381 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,382 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 02:56:43,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:43,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:43,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:43,382 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:43,382 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:43,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:43,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:43,482 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:43,483 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:43,483 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:43,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:43,490 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:43,490 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:43,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:43,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:43,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,495 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 02:56:43,495 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:43,495 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-08 02:56:43,495 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-08 02:56:43,496 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,496 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,507 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:43,507 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:43,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:43,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:43,508 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:43,508 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:43,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:43,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,511 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,512 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-08 02:56:43,512 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:43,512 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-08 02:56:43,512 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:43,512 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-08 02:56:43,512 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:43,513 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:43,513 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:43,513 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. started... 2023-02-08 02:56:43,513 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 12c23930d7c44fc1708b711f7de5640e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:43,937 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228914c77165ad54ad485f862561f55ed3c to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228914c77165ad54ad485f862561f55ed3c 2023-02-08 02:56:44,343 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp/family1/bf5bbfc7c67742cc9ad3dfd458f6e52e 2023-02-08 02:56:44,351 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp/family1/bf5bbfc7c67742cc9ad3dfd458f6e52e as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/bf5bbfc7c67742cc9ad3dfd458f6e52e 2023-02-08 02:56:44,355 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/bf5bbfc7c67742cc9ad3dfd458f6e52e, entries=1, sequenceid=21, filesize=5.0 K 2023-02-08 02:56:44,356 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 12c23930d7c44fc1708b711f7de5640e in 843ms, sequenceid=21, compaction requested=true 2023-02-08 02:56:44,356 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 12c23930d7c44fc1708b711f7de5640e: 2023-02-08 02:56:44,356 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:44,356 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:44,356 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:44,357 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:44,357 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-08 02:56:44,357 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-08 02:56:44,423 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:44,423 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:44,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:44,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:44,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:44,424 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,424 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:44,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:44,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:44,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:44,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-08 02:56:44,429 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-08 02:56:44,429 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@365d49b0[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:44,434 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,434 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-08 02:56:44,434 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-08 02:56:44,434 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:44,434 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:44,435 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:44,444 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-08 02:56:44,444 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:44,444 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:44,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:44,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:44,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:44,444 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-08 02:56:44,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:44,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:44,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:44,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:44,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:44,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:44,454 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-08 02:56:44,454 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-08 02:56:44,455 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:44,455 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:44,455 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,455 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:44,465 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,465 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,465 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:44,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:44,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:44,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:44,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:44,466 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:44,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:44,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:44,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,469 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:44,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:44,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:44,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:44,475 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:44,476 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:44,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:44,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 02:56:44,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:44,476 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-08 02:56:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:44,476 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:44,476 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:44,476 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:44,476 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,476 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:44,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:44,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:44,477 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,477 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:44,477 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,477 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,477 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,577 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:44,577 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:44,577 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:44,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:44,582 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:44,582 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:44,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:44,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:44,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,584 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 02:56:44,584 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:44,584 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-08 02:56:44,584 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-08 02:56:44,585 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,585 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,591 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:44,591 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:44,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:44,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:44,592 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:44,592 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:44,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:44,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,594 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,594 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-08 02:56:44,594 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:44,594 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-08 02:56:44,594 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:44,594 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-08 02:56:44,595 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:44,595 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:44,595 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:44,595 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. started... 2023-02-08 02:56:44,595 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 12c23930d7c44fc1708b711f7de5640e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:45,017 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231eabb5d2ff7cb49abbda79bc2e11f25f9 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231eabb5d2ff7cb49abbda79bc2e11f25f9 2023-02-08 02:56:45,426 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp/family1/18df78e667ac4b2ca81ec0d122e9fea2 2023-02-08 02:56:45,436 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp/family1/18df78e667ac4b2ca81ec0d122e9fea2 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/18df78e667ac4b2ca81ec0d122e9fea2 2023-02-08 02:56:45,440 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/18df78e667ac4b2ca81ec0d122e9fea2, entries=1, sequenceid=25, filesize=5.0 K 2023-02-08 02:56:45,441 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 12c23930d7c44fc1708b711f7de5640e in 846ms, sequenceid=25, compaction requested=true 2023-02-08 02:56:45,441 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 12c23930d7c44fc1708b711f7de5640e: 2023-02-08 02:56:45,441 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:45,441 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:45,441 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:45,441 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:45,441 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-08 02:56:45,441 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-08 02:56:45,486 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,486 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:45,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:45,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:45,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:45,486 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,486 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:45,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:45,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:45,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-08 02:56:45,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a03e9a9[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:45,491 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-08 02:56:45,491 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,496 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,497 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-08 02:56:45,497 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-08 02:56:45,497 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:45,497 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:45,497 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:45,507 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:45,507 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-08 02:56:45,507 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:45,507 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-08 02:56:45,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:45,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:45,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:45,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:45,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:45,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:45,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:45,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:45,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:45,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-08 02:56:45,515 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-08 02:56:45,515 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:45,515 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:45,515 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,515 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:45,560 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,560 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,560 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:45,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:45,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:45,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:45,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:45,561 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:45,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:45,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:45,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,564 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:45,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:45,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:45,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:45,617 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:45,617 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:45,617 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:45,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:45,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:45,617 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:45,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 02:56:45,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:45,617 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,618 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-08 02:56:45,618 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,618 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:45,618 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:45,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:45,618 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:45,618 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,618 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:45,618 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,718 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:45,719 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:45,719 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:45,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:45,727 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:45,727 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:45,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:45,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:45,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,730 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 02:56:45,730 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:45,730 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-08 02:56:45,730 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-08 02:56:45,731 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,731 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,749 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:45,749 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:45,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:45,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:45,750 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:45,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,751 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:45,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,753 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,753 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-08 02:56:45,753 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:45,753 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-08 02:56:45,753 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:45,754 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-08 02:56:45,754 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:45,754 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:45,754 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:45,754 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. started... 2023-02-08 02:56:45,754 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 12c23930d7c44fc1708b711f7de5640e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:46,178 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101d1dfc66935e845bb88bc3c7b7172b30a to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101d1dfc66935e845bb88bc3c7b7172b30a 2023-02-08 02:56:46,587 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp/family1/aa6f747c475140d9b8bf16692a211921 2023-02-08 02:56:46,598 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp/family1/aa6f747c475140d9b8bf16692a211921 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/aa6f747c475140d9b8bf16692a211921 2023-02-08 02:56:46,605 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/aa6f747c475140d9b8bf16692a211921, entries=1, sequenceid=29, filesize=5.0 K 2023-02-08 02:56:46,606 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 12c23930d7c44fc1708b711f7de5640e in 852ms, sequenceid=29, compaction requested=true 2023-02-08 02:56:46,606 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 12c23930d7c44fc1708b711f7de5640e: 2023-02-08 02:56:46,606 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:46,606 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:46,606 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:46,606 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:46,606 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-08 02:56:46,606 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-08 02:56:46,686 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:46,686 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:46,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:46,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:46,687 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,687 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:46,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:46,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:46,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:46,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:46,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-08 02:56:46,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4069d653[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:46,691 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-08 02:56:46,691 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,696 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,697 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-08 02:56:46,697 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-08 02:56:46,697 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:46,697 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:46,697 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:46,707 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-08 02:56:46,707 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:46,707 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:46,707 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-08 02:56:46,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:46,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:46,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:46,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:46,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:46,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:46,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:46,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:46,716 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-08 02:56:46,716 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-08 02:56:46,716 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:46,716 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:46,716 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,716 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:46,728 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,728 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:46,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,728 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:46,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:46,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:46,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:46,729 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:46,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:46,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:46,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,729 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:46,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:46,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:46,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:46,738 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:46,738 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:46,739 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:46,739 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:46,739 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-08 02:56:46,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 02:56:46,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:46,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:46,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:46,739 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,739 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:46,739 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:46,739 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:46,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:46,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:46,739 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,740 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,740 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,839 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:46,840 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:46,840 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:46,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:46,843 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:46,843 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:46,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:46,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:46,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,845 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 02:56:46,845 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:46,845 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-08 02:56:46,845 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-08 02:56:46,846 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,846 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,854 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:46,854 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:46,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:46,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:46,855 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:46,855 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:46,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:46,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,856 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,856 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-08 02:56:46,856 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:46,856 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-08 02:56:46,857 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:46,857 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-08 02:56:46,857 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:46,857 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:46,857 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:46,857 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. started... 2023-02-08 02:56:46,857 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 12c23930d7c44fc1708b711f7de5640e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:47,273 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f64b42c430f84fcbbe5f097c368dfb3b to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103f64b42c430f84fcbbe5f097c368dfb3b 2023-02-08 02:56:47,679 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp/family1/44f324fd86bd43f2980ad23537f4fb7a 2023-02-08 02:56:47,687 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp/family1/44f324fd86bd43f2980ad23537f4fb7a as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/44f324fd86bd43f2980ad23537f4fb7a 2023-02-08 02:56:47,693 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/44f324fd86bd43f2980ad23537f4fb7a, entries=1, sequenceid=33, filesize=5.0 K 2023-02-08 02:56:47,694 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 12c23930d7c44fc1708b711f7de5640e in 837ms, sequenceid=33, compaction requested=true 2023-02-08 02:56:47,694 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 12c23930d7c44fc1708b711f7de5640e: 2023-02-08 02:56:47,694 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:47,694 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:47,694 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:47,694 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:47,694 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-08 02:56:47,694 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-08 02:56:47,760 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,760 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:47,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:47,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:47,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:47,760 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,760 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:47,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:47,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:47,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:47,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:47,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-08 02:56:47,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1229e6e2[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:47,762 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-08 02:56:47,762 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,770 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,770 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-08 02:56:47,770 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-08 02:56:47,770 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:47,770 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:47,771 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:47,780 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-08 02:56:47,780 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:47,780 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:47,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:47,781 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-08 02:56:47,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:47,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:47,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:47,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:47,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:47,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:47,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:47,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:47,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-08 02:56:47,784 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-08 02:56:47,785 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:47,785 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:47,785 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,785 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:47,791 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,791 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:47,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,791 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:47,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:47,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:47,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:47,792 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:47,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:47,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:47,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,793 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:47,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:47,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:47,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:47,802 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:47,802 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:47,802 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:47,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:47,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:47,802 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,802 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 02:56:47,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:47,802 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-08 02:56:47,802 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:47,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:47,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:47,802 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:47,803 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:47,803 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,803 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,803 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:47,803 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,903 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:47,904 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:47,904 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:47,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:47,914 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:47,914 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:47,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:47,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:47,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,919 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 02:56:47,919 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:47,919 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-08 02:56:47,919 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-08 02:56:47,920 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,920 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,996 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:47,996 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:47,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:47,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:47,997 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:47,997 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:47,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:47,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:47,999 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,000 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-08 02:56:48,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,000 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-08 02:56:48,000 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:48,000 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-08 02:56:48,001 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:48,001 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:48,001 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:48,001 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. started... 2023-02-08 02:56:48,001 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 12c23930d7c44fc1708b711f7de5640e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:48,425 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907cffff61965ac4a7585562d988ba9ce94 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907cffff61965ac4a7585562d988ba9ce94 2023-02-08 02:56:48,833 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp/family1/9955a7983e024151824b674eb1f3e55a 2023-02-08 02:56:48,842 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp/family1/9955a7983e024151824b674eb1f3e55a as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/9955a7983e024151824b674eb1f3e55a 2023-02-08 02:56:48,849 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/9955a7983e024151824b674eb1f3e55a, entries=1, sequenceid=37, filesize=5.0 K 2023-02-08 02:56:48,850 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 12c23930d7c44fc1708b711f7de5640e in 849ms, sequenceid=37, compaction requested=true 2023-02-08 02:56:48,850 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 12c23930d7c44fc1708b711f7de5640e: 2023-02-08 02:56:48,850 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:48,850 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:48,850 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:48,850 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:48,850 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-08 02:56:48,850 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-08 02:56:48,918 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:48,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:48,918 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:48,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:48,919 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,919 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:48,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:48,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:48,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:48,925 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-08 02:56:48,925 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e653dde[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:48,925 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-08 02:56:48,925 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,938 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,939 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-08 02:56:48,939 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-08 02:56:48,939 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:48,939 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:48,939 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:48,949 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-08 02:56:48,949 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:48,949 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:48,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:48,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:48,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:48,949 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-08 02:56:48,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:48,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:48,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:48,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:48,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:48,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:48,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-08 02:56:48,957 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-08 02:56:48,957 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:48,957 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:48,957 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,957 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:48,970 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,970 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:48,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,970 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:48,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:48,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:48,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:48,971 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:48,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:48,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:48,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,971 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:48,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:48,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:48,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:48,980 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:48,980 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:48,980 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,980 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:48,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:48,980 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:48,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:48,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-08 02:56:48,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 02:56:48,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:48,980 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,981 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:48,981 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:48,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:48,981 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:48,981 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:48,981 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:48,981 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:49,081 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:49,082 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:49,082 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:49,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:49,092 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:49,092 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:49,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:56:49,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-08 02:56:49,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:49,096 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 02:56:49,096 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:49,096 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-08 02:56:49,096 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-08 02:56:49,097 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:49,097 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:49,107 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:49,107 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:49,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:49,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:49,107 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:49,107 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:56:49,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:49,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:49,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:56:49,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:49,109 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:49,109 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-08 02:56:49,109 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:49,109 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-08 02:56:49,109 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:56:49,109 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-08 02:56:49,110 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:56:49,110 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:56:49,110 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:49,110 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. started... 2023-02-08 02:56:49,110 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 12c23930d7c44fc1708b711f7de5640e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:56:49,535 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120be6461c6b39e4ef2974657562beaca78 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120be6461c6b39e4ef2974657562beaca78 2023-02-08 02:56:49,945 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp/family1/016581cd74c0456594d4678f4b2f3ed5 2023-02-08 02:56:49,956 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp/family1/016581cd74c0456594d4678f4b2f3ed5 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/016581cd74c0456594d4678f4b2f3ed5 2023-02-08 02:56:49,960 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/016581cd74c0456594d4678f4b2f3ed5, entries=1, sequenceid=41, filesize=5.0 K 2023-02-08 02:56:49,960 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 12c23930d7c44fc1708b711f7de5640e in 850ms, sequenceid=41, compaction requested=true 2023-02-08 02:56:49,960 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 12c23930d7c44fc1708b711f7de5640e: 2023-02-08 02:56:49,960 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:49,960 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:56:49,960 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:56:49,960 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:49,960 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-08 02:56:49,961 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-08 02:56:50,002 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:50,002 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:50,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:50,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:50,003 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,003 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:56:50,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:50,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:50,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:50,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:50,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-08 02:56:50,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b0edb1a[Count = 0] remaining members to acquire global barrier 2023-02-08 02:56:50,006 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-08 02:56:50,006 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,012 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,012 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-08 02:56:50,012 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-08 02:56:50,012 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:56:50,013 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:50,013 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:56:50,023 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:50,023 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-08 02:56:50,023 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:50,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:50,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:50,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:50,023 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-08 02:56:50,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:50,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:50,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:50,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:50,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:50,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:56:50,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-08 02:56:50,031 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-08 02:56:50,031 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:56:50,031 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:56:50,031 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,031 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:56:50,044 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,044 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:50,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,044 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:56:50,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:56:50,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:50,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:50,045 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:50,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:56:50,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:56:50,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,047 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:50,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:50,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:56:50,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:50,054 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:50,054 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,054 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,054 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:50,054 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,054 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,054 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:56:50,054 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:56:50,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 02:56:50,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:56:50,054 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-08 02:56:50,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:56:50,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:56:50,055 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:56:50,055 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-08 02:56:50,055 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:56:50,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:56:50,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:56:50,156 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:56:50,156 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:50,156 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:50,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:56:50,162 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:50,166 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-08 02:56:50,167 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-08 02:56:50,167 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675825610167 2023-02-08 02:56:50,167 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:56:50,170 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 02:56:50,171 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-08 02:56:50,171 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 02:56:50,171 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] zookeeper.ReadOnlyZKClient(139): Connect 0x354685a3 to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:56:50,181 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4996f253, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:56:50,181 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:51,040 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010303415750e6124aad80d22581f4497ba6 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010303415750e6124aad80d22581f4497ba6 2023-02-08 02:56:51,041 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 02:56:51,052 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 02:56:51,053 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:35332, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 02:56:51,059 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:51,060 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:51,061 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 02:56:51,062 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:55244, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 02:56:51,072 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e9ecc7372a2047ae93de073059a8f41d first=Optional[r3] last=Optional[r6] 2023-02-08 02:56:51,073 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e9ecc7372a2047ae93de073059a8f41d}] 2023-02-08 02:56:51,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e9ecc7372a2047ae93de073059a8f41d for inclusion in 12c23930d7c44fc1708b711f7de5640e/family1 2023-02-08 02:56:51,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-08 02:56:51,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 02:56:51,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for 12c23930d7c44fc1708b711f7de5640e: 2023-02-08 02:56:51,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e9ecc7372a2047ae93de073059a8f41d to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fvcdqs5btigfq3kqkgv8bhqp3g1svitmg02m9mpedfmcdgeaga7bg7hcr4hee2se/family1/e9ecc7372a2047ae93de073059a8f41d 2023-02-08 02:56:51,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fvcdqs5btigfq3kqkgv8bhqp3g1svitmg02m9mpedfmcdgeaga7bg7hcr4hee2se/family1/e9ecc7372a2047ae93de073059a8f41d as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/4e1c76d8d22647ce8edc5c679a8b3b7d_SeqId_44_ 2023-02-08 02:56:51,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fvcdqs5btigfq3kqkgv8bhqp3g1svitmg02m9mpedfmcdgeaga7bg7hcr4hee2se/family1/e9ecc7372a2047ae93de073059a8f41d into 12c23930d7c44fc1708b711f7de5640e/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/4e1c76d8d22647ce8edc5c679a8b3b7d_SeqId_44_ - updating store file list. 2023-02-08 02:56:51,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/4e1c76d8d22647ce8edc5c679a8b3b7d_SeqId_44_ into 12c23930d7c44fc1708b711f7de5640e/family1 2023-02-08 02:56:51,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fvcdqs5btigfq3kqkgv8bhqp3g1svitmg02m9mpedfmcdgeaga7bg7hcr4hee2se/family1/e9ecc7372a2047ae93de073059a8f41d into 12c23930d7c44fc1708b711f7de5640e/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/4e1c76d8d22647ce8edc5c679a8b3b7d_SeqId_44_) 2023-02-08 02:56:51,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fvcdqs5btigfq3kqkgv8bhqp3g1svitmg02m9mpedfmcdgeaga7bg7hcr4hee2se/family1/e9ecc7372a2047ae93de073059a8f41d 2023-02-08 02:56:51,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-08 02:56:51,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-08 02:56:51,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(1912): 12c23930d7c44fc1708b711f7de5640e/family1 is initiating minor compaction 2023-02-08 02:56:51,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@612f4f6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:56:51,091 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 12c23930d7c44fc1708b711f7de5640e/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:51,091 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/ccc1b040ae0c4654b3ec2839c43e0c09, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/842052b569d240a586b0ebe6d218b071, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/562ac8b635834c7aaeab5fb85a9eb466, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/bf5bbfc7c67742cc9ad3dfd458f6e52e, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/18df78e667ac4b2ca81ec0d122e9fea2, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/aa6f747c475140d9b8bf16692a211921, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/44f324fd86bd43f2980ad23537f4fb7a, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/9955a7983e024151824b674eb1f3e55a, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/016581cd74c0456594d4678f4b2f3ed5, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/4e1c76d8d22647ce8edc5c679a8b3b7d_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp, totalSize=50.3 K 2023-02-08 02:56:51,091 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting ccc1b040ae0c4654b3ec2839c43e0c09, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-08 02:56:51,091 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 842052b569d240a586b0ebe6d218b071, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-08 02:56:51,091 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 562ac8b635834c7aaeab5fb85a9eb466, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-08 02:56:51,091 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting bf5bbfc7c67742cc9ad3dfd458f6e52e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-08 02:56:51,091 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 18df78e667ac4b2ca81ec0d122e9fea2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-08 02:56:51,091 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting aa6f747c475140d9b8bf16692a211921, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-08 02:56:51,092 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 44f324fd86bd43f2980ad23537f4fb7a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-08 02:56:51,092 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 9955a7983e024151824b674eb1f3e55a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-08 02:56:51,092 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 016581cd74c0456594d4678f4b2f3ed5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-08 02:56:51,092 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 4e1c76d8d22647ce8edc5c679a8b3b7d_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-08 02:56:51,092 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 02:56:51,093 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:56:51,094 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228914c77165ad54ad485f862561f55ed3c to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228914c77165ad54ad485f862561f55ed3c 2023-02-08 02:56:51,096 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231eabb5d2ff7cb49abbda79bc2e11f25f9 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231eabb5d2ff7cb49abbda79bc2e11f25f9 2023-02-08 02:56:51,097 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101d1dfc66935e845bb88bc3c7b7172b30a to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101d1dfc66935e845bb88bc3c7b7172b30a 2023-02-08 02:56:51,097 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103f64b42c430f84fcbbe5f097c368dfb3b to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103f64b42c430f84fcbbe5f097c368dfb3b 2023-02-08 02:56:51,097 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-02-08 02:56:51,097 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-08 02:56:51,098 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:51,098 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:51,098 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:51,098 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:51,098 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:51,098 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:51,098 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:51,098 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:51,117 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] throttle.PressureAwareThroughputController(145): 12c23930d7c44fc1708b711f7de5640e#family1#compaction#73 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-08 02:56:51,935 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp/family1/022422236fac425b8916cd2dbefcb183 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/022422236fac425b8916cd2dbefcb183 2023-02-08 02:56:51,940 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205de312f4ec3bd4310b49974b64868387b to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205de312f4ec3bd4310b49974b64868387b 2023-02-08 02:56:51,941 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 12c23930d7c44fc1708b711f7de5640e/family1 of 12c23930d7c44fc1708b711f7de5640e into 022422236fac425b8916cd2dbefcb183(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 02:56:51,941 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 12c23930d7c44fc1708b711f7de5640e: 2023-02-08 02:56:51,941 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 02:56:51,941 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1675825011091; duration=0sec 2023-02-08 02:56:51,942 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:56:51,956 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:51,956 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:51,963 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/93e220bba10f49eea6bac3c518dbd3e9 first=Optional[r00] last=Optional[r2] 2023-02-08 02:56:51,963 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/93e220bba10f49eea6bac3c518dbd3e9}] 2023-02-08 02:56:51,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/93e220bba10f49eea6bac3c518dbd3e9 for inclusion in 12c23930d7c44fc1708b711f7de5640e/family1 2023-02-08 02:56:51,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-08 02:56:51,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 02:56:51,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for 12c23930d7c44fc1708b711f7de5640e: 2023-02-08 02:56:51,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/93e220bba10f49eea6bac3c518dbd3e9 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ei5n6l66udgqbbri47q6mb943cadleuv7f1tefv0rvttgr72aj795133tmd4h2rb/family1/93e220bba10f49eea6bac3c518dbd3e9 2023-02-08 02:56:51,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ei5n6l66udgqbbri47q6mb943cadleuv7f1tefv0rvttgr72aj795133tmd4h2rb/family1/93e220bba10f49eea6bac3c518dbd3e9 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/a5200ed6f4d2434281ec8fa3c4d8fcb2_SeqId_47_ 2023-02-08 02:56:51,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ei5n6l66udgqbbri47q6mb943cadleuv7f1tefv0rvttgr72aj795133tmd4h2rb/family1/93e220bba10f49eea6bac3c518dbd3e9 into 12c23930d7c44fc1708b711f7de5640e/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/a5200ed6f4d2434281ec8fa3c4d8fcb2_SeqId_47_ - updating store file list. 2023-02-08 02:56:51,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/a5200ed6f4d2434281ec8fa3c4d8fcb2_SeqId_47_ into 12c23930d7c44fc1708b711f7de5640e/family1 2023-02-08 02:56:51,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ei5n6l66udgqbbri47q6mb943cadleuv7f1tefv0rvttgr72aj795133tmd4h2rb/family1/93e220bba10f49eea6bac3c518dbd3e9 into 12c23930d7c44fc1708b711f7de5640e/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/a5200ed6f4d2434281ec8fa3c4d8fcb2_SeqId_47_) 2023-02-08 02:56:51,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ei5n6l66udgqbbri47q6mb943cadleuv7f1tefv0rvttgr72aj795133tmd4h2rb/family1/93e220bba10f49eea6bac3c518dbd3e9 2023-02-08 02:56:51,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-08 02:56:51,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-08 02:56:51,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(1912): 12c23930d7c44fc1708b711f7de5640e/family1 is initiating minor compaction (all files) 2023-02-08 02:56:51,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7a901b7f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-08 02:56:51,977 INFO [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 12c23930d7c44fc1708b711f7de5640e/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:51,977 INFO [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/4332733dd18b4896b90883e7d1bdfd03, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/022422236fac425b8916cd2dbefcb183, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/a5200ed6f4d2434281ec8fa3c4d8fcb2_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp, totalSize=388.1 K 2023-02-08 02:56:51,978 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] compactions.Compactor(207): Compacting 4332733dd18b4896b90883e7d1bdfd03, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878815769 2023-02-08 02:56:51,978 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] compactions.Compactor(207): Compacting 022422236fac425b8916cd2dbefcb183, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621215769 2023-02-08 02:56:51,979 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] compactions.Compactor(207): Compacting a5200ed6f4d2434281ec8fa3c4d8fcb2_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878815769 2023-02-08 02:56:51,979 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 02:56:51,979 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:56:51,981 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113026f4bb1b5c5a47c69759df613573e0b6 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113026f4bb1b5c5a47c69759df613573e0b6 2023-02-08 02:56:51,982 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201f7a014956f644595a151bae566bc9b44 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201f7a014956f644595a151bae566bc9b44 2023-02-08 02:56:51,983 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512057ff64c2ce93f45e09ac560b0626dbc24 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512057ff64c2ce93f45e09ac560b0626dbc24 2023-02-08 02:56:51,983 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-02-08 02:56:51,983 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-08 02:56:51,984 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:51,984 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 02:56:51,984 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:56:51,985 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-08 02:56:51,986 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.8210 sec 2023-02-08 02:56:52,001 INFO [RS:0;jenkins-hbase12:44577-longCompactions-0] throttle.PressureAwareThroughputController(145): 12c23930d7c44fc1708b711f7de5640e#family1#compaction#74 average throughput is 13.82 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-08 02:56:52,019 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/ccc1b040ae0c4654b3ec2839c43e0c09, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/842052b569d240a586b0ebe6d218b071, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/562ac8b635834c7aaeab5fb85a9eb466, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/bf5bbfc7c67742cc9ad3dfd458f6e52e, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/18df78e667ac4b2ca81ec0d122e9fea2, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/aa6f747c475140d9b8bf16692a211921, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/44f324fd86bd43f2980ad23537f4fb7a, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/9955a7983e024151824b674eb1f3e55a, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/016581cd74c0456594d4678f4b2f3ed5, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/4e1c76d8d22647ce8edc5c679a8b3b7d_SeqId_44_] to archive 2023-02-08 02:56:52,019 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:56:52,021 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/ccc1b040ae0c4654b3ec2839c43e0c09 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/ccc1b040ae0c4654b3ec2839c43e0c09 2023-02-08 02:56:52,022 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/842052b569d240a586b0ebe6d218b071 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/842052b569d240a586b0ebe6d218b071 2023-02-08 02:56:52,024 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/562ac8b635834c7aaeab5fb85a9eb466 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/562ac8b635834c7aaeab5fb85a9eb466 2023-02-08 02:56:52,025 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/bf5bbfc7c67742cc9ad3dfd458f6e52e to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/bf5bbfc7c67742cc9ad3dfd458f6e52e 2023-02-08 02:56:52,026 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/18df78e667ac4b2ca81ec0d122e9fea2 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/18df78e667ac4b2ca81ec0d122e9fea2 2023-02-08 02:56:52,028 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/aa6f747c475140d9b8bf16692a211921 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/aa6f747c475140d9b8bf16692a211921 2023-02-08 02:56:52,029 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/44f324fd86bd43f2980ad23537f4fb7a to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/44f324fd86bd43f2980ad23537f4fb7a 2023-02-08 02:56:52,030 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/9955a7983e024151824b674eb1f3e55a to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/9955a7983e024151824b674eb1f3e55a 2023-02-08 02:56:52,031 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/016581cd74c0456594d4678f4b2f3ed5 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/016581cd74c0456594d4678f4b2f3ed5 2023-02-08 02:56:52,033 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/4e1c76d8d22647ce8edc5c679a8b3b7d_SeqId_44_ to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/4e1c76d8d22647ce8edc5c679a8b3b7d_SeqId_44_ 2023-02-08 02:56:52,053 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:52,053 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:52,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.HMaster$12(2441): Client=jenkins//136.243.104.168 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-08 02:56:52,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:52,466 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-08 02:56:52,467 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-08 02:56:52,467 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-08 02:56:52,470 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-08 02:56:52,473 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=12c23930d7c44fc1708b711f7de5640e, REOPEN/MOVE}] 2023-02-08 02:56:52,474 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=12c23930d7c44fc1708b711f7de5640e, REOPEN/MOVE 2023-02-08 02:56:52,474 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=12c23930d7c44fc1708b711f7de5640e, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:52,474 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675825012474"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675825012474"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675825012474"}]},"ts":"1675825012474"} 2023-02-08 02:56:52,475 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 12c23930d7c44fc1708b711f7de5640e, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:56:52,627 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close 12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:52,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 12c23930d7c44fc1708b711f7de5640e, disabling compactions & flushes 2023-02-08 02:56:52,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:53,241 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/.tmp/family1/c4e78f1b00d446c3b76563b7f3bebdd2 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/c4e78f1b00d446c3b76563b7f3bebdd2 2023-02-08 02:56:53,246 INFO [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 12c23930d7c44fc1708b711f7de5640e/family1 of 12c23930d7c44fc1708b711f7de5640e into c4e78f1b00d446c3b76563b7f3bebdd2(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:56:53,246 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 12c23930d7c44fc1708b711f7de5640e: 2023-02-08 02:56:53,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:53,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:53,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. after waiting 0 ms 2023-02-08 02:56:53,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:53,246 INFO [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1675825011977; duration=1sec 2023-02-08 02:56:53,246 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:56:53,249 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/4332733dd18b4896b90883e7d1bdfd03, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/022422236fac425b8916cd2dbefcb183, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/a5200ed6f4d2434281ec8fa3c4d8fcb2_SeqId_47_] to archive 2023-02-08 02:56:53,249 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:56:53,251 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/4332733dd18b4896b90883e7d1bdfd03 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/4332733dd18b4896b90883e7d1bdfd03 2023-02-08 02:56:53,252 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/022422236fac425b8916cd2dbefcb183 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/022422236fac425b8916cd2dbefcb183 2023-02-08 02:56:53,254 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/a5200ed6f4d2434281ec8fa3c4d8fcb2_SeqId_47_ to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/a5200ed6f4d2434281ec8fa3c4d8fcb2_SeqId_47_ 2023-02-08 02:56:53,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-08 02:56:53,260 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:53,260 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 12c23930d7c44fc1708b711f7de5640e: Waiting for close lock at 1675825012628Running coprocessor pre-close hooks at 1675825012628Disabling compacts and flushes for region at 1675825012628Disabling writes for close at 1675825013246 (+618 ms)Writing region close event to WAL at 1675825013256 (+10 ms)Running coprocessor post-close hooks at 1675825013259 (+3 ms)Closed at 1675825013260 (+1 ms) 2023-02-08 02:56:53,260 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 12c23930d7c44fc1708b711f7de5640e to self. 2023-02-08 02:56:53,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed 12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:53,262 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=12c23930d7c44fc1708b711f7de5640e, regionState=CLOSED 2023-02-08 02:56:53,262 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675825013262"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675825013262"}]},"ts":"1675825013262"} 2023-02-08 02:56:53,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-02-08 02:56:53,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 12c23930d7c44fc1708b711f7de5640e, server=jenkins-hbase12.apache.org,44577,1675824910652 in 788 msec 2023-02-08 02:56:53,265 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=12c23930d7c44fc1708b711f7de5640e, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=true 2023-02-08 02:56:53,415 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=12c23930d7c44fc1708b711f7de5640e, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:53,416 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675825013415"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675825013415"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675825013415"}]},"ts":"1675825013415"} 2023-02-08 02:56:53,417 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 12c23930d7c44fc1708b711f7de5640e, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:56:53,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:53,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 12c23930d7c44fc1708b711f7de5640e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.', STARTKEY => '', ENDKEY => ''} 2023-02-08 02:56:53,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:53,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:56:53,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:53,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:53,574 INFO [StoreOpener-12c23930d7c44fc1708b711f7de5640e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:53,576 DEBUG [StoreOpener-12c23930d7c44fc1708b711f7de5640e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1 2023-02-08 02:56:53,576 DEBUG [StoreOpener-12c23930d7c44fc1708b711f7de5640e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1 2023-02-08 02:56:53,577 INFO [StoreOpener-12c23930d7c44fc1708b711f7de5640e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12c23930d7c44fc1708b711f7de5640e columnFamilyName family1 2023-02-08 02:56:53,585 DEBUG [StoreOpener-12c23930d7c44fc1708b711f7de5640e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/c4e78f1b00d446c3b76563b7f3bebdd2 2023-02-08 02:56:53,585 INFO [StoreOpener-12c23930d7c44fc1708b711f7de5640e-1] regionserver.HStore(310): Store=12c23930d7c44fc1708b711f7de5640e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:56:53,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:53,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:53,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:53,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 12c23930d7c44fc1708b711f7de5640e; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73574436, jitterRate=0.09634453058242798}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 02:56:53,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 12c23930d7c44fc1708b711f7de5640e: Running coprocessor pre-open hook at 1675825013573Writing region info on filesystem at 1675825013573Initializing all the Stores at 1675825013574 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675825013574Cleaning up temporary data from old regions at 1675825013589 (+15 ms)Cleaning up detritus from prior splits at 1675825013590 (+1 ms)Running coprocessor post-open hooks at 1675825013594 (+4 ms)Region opened successfully at 1675825013594 2023-02-08 02:56:53,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e., pid=63, masterSystemTime=1675825013568 2023-02-08 02:56:53,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:53,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:53,598 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=12c23930d7c44fc1708b711f7de5640e, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:53,598 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675825013598"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675825013598"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675825013598"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675825013598"}]},"ts":"1675825013598"} 2023-02-08 02:56:53,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-02-08 02:56:53,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 12c23930d7c44fc1708b711f7de5640e, server=jenkins-hbase12.apache.org,44577,1675824910652 in 183 msec 2023-02-08 02:56:53,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-02-08 02:56:53,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=12c23930d7c44fc1708b711f7de5640e, REOPEN/MOVE in 1.1290 sec 2023-02-08 02:56:53,607 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-02-08 02:56:53,607 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1350 sec 2023-02-08 02:56:53,608 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5540 sec 2023-02-08 02:56:53,609 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:53,609 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:53,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-02-08 02:56:53,610 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:53,610 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:53,610 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:53,610 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:53,611 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(278): alter status finished 2023-02-08 02:56:53,612 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:53,613 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-08 02:56:53,613 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-08 02:56:53,614 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:56:53,614 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675825613614 2023-02-08 02:56:53,614 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 02:56:53,615 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-08 02:56:53,615 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 02:56:53,615 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] zookeeper.ReadOnlyZKClient(139): Connect 0x376b1e55 to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:56:53,688 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20be13e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:56:53,689 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:53,689 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:53,689 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:53,689 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:53,689 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:54,534 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112855356a3e26da4822975e0a2bd3c33dd5 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112855356a3e26da4822975e0a2bd3c33dd5 2023-02-08 02:56:54,535 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 02:56:54,549 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 02:56:54,550 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:35334, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 02:56:54,555 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:54,555 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:54,555 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 02:56:54,557 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:55246, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 02:56:54,565 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/487240d0978d4fc1979cb450e00565a4 first=Optional[r05] last=Optional[r8] 2023-02-08 02:56:54,565 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/487240d0978d4fc1979cb450e00565a4}] 2023-02-08 02:56:54,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/487240d0978d4fc1979cb450e00565a4 for inclusion in 12c23930d7c44fc1708b711f7de5640e/family1 2023-02-08 02:56:54,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-08 02:56:54,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 02:56:54,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for 12c23930d7c44fc1708b711f7de5640e: 2023-02-08 02:56:54,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/487240d0978d4fc1979cb450e00565a4 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__akdorqpkb01968cm2nma2dsmlcmbs908q23mutd64mihoblnvedahrr68motitpi/family1/487240d0978d4fc1979cb450e00565a4 2023-02-08 02:56:54,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__akdorqpkb01968cm2nma2dsmlcmbs908q23mutd64mihoblnvedahrr68motitpi/family1/487240d0978d4fc1979cb450e00565a4 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/22e8527d42df4b8793a435c97bfce170_SeqId_53_ 2023-02-08 02:56:54,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__akdorqpkb01968cm2nma2dsmlcmbs908q23mutd64mihoblnvedahrr68motitpi/family1/487240d0978d4fc1979cb450e00565a4 into 12c23930d7c44fc1708b711f7de5640e/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/22e8527d42df4b8793a435c97bfce170_SeqId_53_ - updating store file list. 2023-02-08 02:56:54,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/22e8527d42df4b8793a435c97bfce170_SeqId_53_ into 12c23930d7c44fc1708b711f7de5640e/family1 2023-02-08 02:56:54,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__akdorqpkb01968cm2nma2dsmlcmbs908q23mutd64mihoblnvedahrr68motitpi/family1/487240d0978d4fc1979cb450e00565a4 into 12c23930d7c44fc1708b711f7de5640e/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/22e8527d42df4b8793a435c97bfce170_SeqId_53_) 2023-02-08 02:56:54,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__akdorqpkb01968cm2nma2dsmlcmbs908q23mutd64mihoblnvedahrr68motitpi/family1/487240d0978d4fc1979cb450e00565a4 2023-02-08 02:56:54,580 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 02:56:54,581 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:56:54,583 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120be6461c6b39e4ef2974657562beaca78 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120be6461c6b39e4ef2974657562beaca78 2023-02-08 02:56:54,584 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112862b5415bed654ba3b35cc85ca664afa7 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112862b5415bed654ba3b35cc85ca664afa7 2023-02-08 02:56:54,584 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-02-08 02:56:54,584 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-08 02:56:54,585 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:54,585 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:54,585 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:54,585 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 02:56:54,585 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:56:54,586 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-08 02:56:54,587 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 974 msec 2023-02-08 02:56:54,648 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:54,648 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:54,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.HMaster$12(2441): Client=jenkins//136.243.104.168 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-02-08 02:56:54,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:55,061 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-08 02:56:55,064 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-08 02:56:55,065 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-08 02:56:55,070 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-08 02:56:55,074 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=12c23930d7c44fc1708b711f7de5640e, REOPEN/MOVE}] 2023-02-08 02:56:55,075 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=12c23930d7c44fc1708b711f7de5640e, REOPEN/MOVE 2023-02-08 02:56:55,076 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=12c23930d7c44fc1708b711f7de5640e, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:55,076 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675825015076"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675825015076"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675825015076"}]},"ts":"1675825015076"} 2023-02-08 02:56:55,078 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 12c23930d7c44fc1708b711f7de5640e, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:56:55,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close 12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:55,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 12c23930d7c44fc1708b711f7de5640e, disabling compactions & flushes 2023-02-08 02:56:55,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:55,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:55,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. after waiting 0 ms 2023-02-08 02:56:55,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:55,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-08 02:56:55,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:55,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 12c23930d7c44fc1708b711f7de5640e: Waiting for close lock at 1675825015231Running coprocessor pre-close hooks at 1675825015231Disabling compacts and flushes for region at 1675825015231Disabling writes for close at 1675825015232 (+1 ms)Writing region close event to WAL at 1675825015239 (+7 ms)Running coprocessor post-close hooks at 1675825015246 (+7 ms)Closed at 1675825015246 2023-02-08 02:56:55,246 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 12c23930d7c44fc1708b711f7de5640e to self. 2023-02-08 02:56:55,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed 12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:55,248 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=12c23930d7c44fc1708b711f7de5640e, regionState=CLOSED 2023-02-08 02:56:55,248 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675825015248"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675825015248"}]},"ts":"1675825015248"} 2023-02-08 02:56:55,251 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-02-08 02:56:55,251 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 12c23930d7c44fc1708b711f7de5640e, server=jenkins-hbase12.apache.org,44577,1675824910652 in 172 msec 2023-02-08 02:56:55,252 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=12c23930d7c44fc1708b711f7de5640e, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=true 2023-02-08 02:56:55,403 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=12c23930d7c44fc1708b711f7de5640e, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:55,403 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675825015402"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675825015402"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675825015402"}]},"ts":"1675825015402"} 2023-02-08 02:56:55,407 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 12c23930d7c44fc1708b711f7de5640e, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:56:55,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:55,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 12c23930d7c44fc1708b711f7de5640e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.', STARTKEY => '', ENDKEY => ''} 2023-02-08 02:56:55,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:55,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:56:55,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:55,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:55,571 INFO [StoreOpener-12c23930d7c44fc1708b711f7de5640e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:55,573 DEBUG [StoreOpener-12c23930d7c44fc1708b711f7de5640e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1 2023-02-08 02:56:55,573 DEBUG [StoreOpener-12c23930d7c44fc1708b711f7de5640e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1 2023-02-08 02:56:55,573 INFO [StoreOpener-12c23930d7c44fc1708b711f7de5640e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12c23930d7c44fc1708b711f7de5640e columnFamilyName family1 2023-02-08 02:56:55,582 DEBUG [StoreOpener-12c23930d7c44fc1708b711f7de5640e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/22e8527d42df4b8793a435c97bfce170_SeqId_53_ 2023-02-08 02:56:55,587 DEBUG [StoreOpener-12c23930d7c44fc1708b711f7de5640e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/family1/c4e78f1b00d446c3b76563b7f3bebdd2 2023-02-08 02:56:55,587 INFO [StoreOpener-12c23930d7c44fc1708b711f7de5640e-1] regionserver.HStore(310): Store=12c23930d7c44fc1708b711f7de5640e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:56:55,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:55,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:55,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:56:55,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 12c23930d7c44fc1708b711f7de5640e; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72802957, jitterRate=0.08484859764575958}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 02:56:55,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 12c23930d7c44fc1708b711f7de5640e: Running coprocessor pre-open hook at 1675825015568Writing region info on filesystem at 1675825015568Initializing all the Stores at 1675825015570 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} at 1675825015570Cleaning up temporary data from old regions at 1675825015591 (+21 ms)Cleaning up detritus from prior splits at 1675825015592 (+1 ms)Running coprocessor post-open hooks at 1675825015596 (+4 ms)Region opened successfully at 1675825015596 2023-02-08 02:56:55,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e., pid=69, masterSystemTime=1675825015560 2023-02-08 02:56:55,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:55,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:56:55,599 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=12c23930d7c44fc1708b711f7de5640e, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:55,599 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675825015599"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675825015599"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675825015599"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675825015599"}]},"ts":"1675825015599"} 2023-02-08 02:56:55,603 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-02-08 02:56:55,603 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 12c23930d7c44fc1708b711f7de5640e, server=jenkins-hbase12.apache.org,44577,1675824910652 in 194 msec 2023-02-08 02:56:55,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-02-08 02:56:55,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=12c23930d7c44fc1708b711f7de5640e, REOPEN/MOVE in 529 msec 2023-02-08 02:56:55,608 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-02-08 02:56:55,608 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 536 msec 2023-02-08 02:56:55,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 960 msec 2023-02-08 02:56:55,611 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:55,611 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:55,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-02-08 02:56:55,613 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:55,613 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:55,614 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:55,614 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:55,615 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(278): alter status finished 2023-02-08 02:56:55,616 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 02:56:55,617 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-08 02:56:55,618 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-08 02:56:55,619 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:56:55,619 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675825615619 2023-02-08 02:56:55,620 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 02:56:55,620 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-08 02:56:55,620 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 02:56:55,621 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] zookeeper.ReadOnlyZKClient(139): Connect 0x67cc5d9e to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:56:55,676 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3add6c25, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:56:55,676 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:55,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:55,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:55,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:55,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:55,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:55,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:55,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 02:56:55,677 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 02:56:55,677 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:56:55,679 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-08 02:56:55,681 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 63 msec 2023-02-08 02:56:55,729 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=249 (was 240) - Thread LEAK? -, OpenFileDescriptor=635 (was 608) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=126 (was 154), ProcessCount=172 (was 176), AvailableMemoryMB=3396 (was 3421) 2023-02-08 02:56:55,740 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=249, OpenFileDescriptor=635, MaxFileDescriptor=60000, SystemLoadAverage=126, ProcessCount=172, AvailableMemoryMB=3396 2023-02-08 02:56:55,741 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:55,741 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:55,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-08 02:56:55,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-02-08 02:56:55,745 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 02:56:55,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-02-08 02:56:55,745 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 02:56:55,745 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:55,745 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:55,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-08 02:56:55,746 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81 2023-02-08 02:56:55,747 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81 empty. 2023-02-08 02:56:55,747 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81 2023-02-08 02:56:55,747 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-08 02:56:55,768 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 02:56:55,769 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x376b1e55 to 127.0.0.1:49602 2023-02-08 02:56:55,769 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:56:55,769 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 02:56:55,769 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5fd636b9 to 127.0.0.1:49602 2023-02-08 02:56:55,769 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:56:55,769 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67cc5d9e to 127.0.0.1:49602 2023-02-08 02:56:55,769 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:56:55,769 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 02:56:55,769 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c8a2ca7 to 127.0.0.1:49602 2023-02-08 02:56:55,770 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:56:55,770 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ec3e51c to 127.0.0.1:49602 2023-02-08 02:56:55,770 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:56:55,770 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 02:56:55,770 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x354685a3 to 127.0.0.1:49602 2023-02-08 02:56:55,770 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:56:55,846 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:55,846 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:55,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-08 02:56:56,048 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:56,048 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:56,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-08 02:56:56,176 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-02-08 02:56:56,179 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3c30914da1cf136d80bae962b3fdcb81, NAME => 'testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp 2023-02-08 02:56:56,349 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:56,349 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:56,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-08 02:56:56,592 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:56:56,592 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1603): Closing 3c30914da1cf136d80bae962b3fdcb81, disabling compactions & flushes 2023-02-08 02:56:56,592 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81. 2023-02-08 02:56:56,592 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81. 2023-02-08 02:56:56,592 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81. after waiting 0 ms 2023-02-08 02:56:56,592 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81. 2023-02-08 02:56:56,593 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81. 2023-02-08 02:56:56,593 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1557): Region close journal for 3c30914da1cf136d80bae962b3fdcb81: Waiting for close lock at 1675825016592Disabling compacts and flushes for region at 1675825016592Disabling writes for close at 1675825016592Writing region close event to WAL at 1675825016593 (+1 ms)Closed at 1675825016593 2023-02-08 02:56:56,599 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 02:56:56,601 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675825016601"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675825016601"}]},"ts":"1675825016601"} 2023-02-08 02:56:56,603 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 02:56:56,603 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 02:56:56,604 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675825016604"}]},"ts":"1675825016604"} 2023-02-08 02:56:56,605 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-02-08 02:56:56,737 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=3c30914da1cf136d80bae962b3fdcb81, ASSIGN}] 2023-02-08 02:56:56,741 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=3c30914da1cf136d80bae962b3fdcb81, ASSIGN 2023-02-08 02:56:56,742 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=3c30914da1cf136d80bae962b3fdcb81, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=false 2023-02-08 02:56:56,852 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:56,853 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:56,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-08 02:56:56,893 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=3c30914da1cf136d80bae962b3fdcb81, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:56,894 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675825016893"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675825016893"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675825016893"}]},"ts":"1675825016893"} 2023-02-08 02:56:56,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 3c30914da1cf136d80bae962b3fdcb81, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:56:57,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81. 2023-02-08 02:56:57,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3c30914da1cf136d80bae962b3fdcb81, NAME => 'testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81.', STARTKEY => '', ENDKEY => ''} 2023-02-08 02:56:57,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-02-08 02:56:57,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-02-08 02:56:57,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 3c30914da1cf136d80bae962b3fdcb81 2023-02-08 02:56:57,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:56:57,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 3c30914da1cf136d80bae962b3fdcb81 2023-02-08 02:56:57,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 3c30914da1cf136d80bae962b3fdcb81 2023-02-08 02:56:57,057 INFO [StoreOpener-3c30914da1cf136d80bae962b3fdcb81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3c30914da1cf136d80bae962b3fdcb81 2023-02-08 02:56:57,059 DEBUG [StoreOpener-3c30914da1cf136d80bae962b3fdcb81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1 2023-02-08 02:56:57,059 DEBUG [StoreOpener-3c30914da1cf136d80bae962b3fdcb81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1 2023-02-08 02:56:57,060 INFO [StoreOpener-3c30914da1cf136d80bae962b3fdcb81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c30914da1cf136d80bae962b3fdcb81 columnFamilyName f1 2023-02-08 02:56:57,062 INFO [StoreOpener-3c30914da1cf136d80bae962b3fdcb81-1] regionserver.HStore(310): Store=3c30914da1cf136d80bae962b3fdcb81/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:56:57,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81 2023-02-08 02:56:57,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81 2023-02-08 02:56:57,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 3c30914da1cf136d80bae962b3fdcb81 2023-02-08 02:56:57,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:56:57,071 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 3c30914da1cf136d80bae962b3fdcb81; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59096673, jitterRate=-0.11939094960689545}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 02:56:57,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 3c30914da1cf136d80bae962b3fdcb81: Running coprocessor pre-open hook at 1675825017055Writing region info on filesystem at 1675825017056 (+1 ms)Initializing all the Stores at 1675825017057 (+1 ms)Instantiating store for column family {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825017057Cleaning up temporary data from old regions at 1675825017064 (+7 ms)Cleaning up detritus from prior splits at 1675825017065 (+1 ms)Running coprocessor post-open hooks at 1675825017071 (+6 ms)Region opened successfully at 1675825017071 2023-02-08 02:56:57,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81., pid=73, masterSystemTime=1675825017048 2023-02-08 02:56:57,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81. 2023-02-08 02:56:57,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81. 2023-02-08 02:56:57,075 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=3c30914da1cf136d80bae962b3fdcb81, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:56:57,075 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675825017075"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675825017075"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675825017075"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675825017075"}]},"ts":"1675825017075"} 2023-02-08 02:56:57,079 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-02-08 02:56:57,079 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 3c30914da1cf136d80bae962b3fdcb81, server=jenkins-hbase12.apache.org,44577,1675824910652 in 180 msec 2023-02-08 02:56:57,081 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-02-08 02:56:57,081 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=3c30914da1cf136d80bae962b3fdcb81, ASSIGN in 342 msec 2023-02-08 02:56:57,082 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 02:56:57,082 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675825017082"}]},"ts":"1675825017082"} 2023-02-08 02:56:57,083 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-02-08 02:56:57,129 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 02:56:57,133 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.3870 sec 2023-02-08 02:56:57,856 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:56:57,856 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:56:57,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-08 02:56:57,858 INFO [Listener at localhost.localdomain/44017] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-02-08 02:56:57,859 DEBUG [Listener at localhost.localdomain/44017] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-02-08 02:56:57,862 INFO [Listener at localhost.localdomain/44017] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 02:56:57,866 INFO [Listener at localhost.localdomain/44017] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-02-08 02:56:57,866 INFO [Listener at localhost.localdomain/44017] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 02:56:57,867 INFO [Listener at localhost.localdomain/44017] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-02-08 02:56:57,871 INFO [Listener at localhost.localdomain/44017] regionserver.HRegion(2744): Flushing 3c30914da1cf136d80bae962b3fdcb81 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-08 02:56:58,285 INFO [Listener at localhost.localdomain/44017] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208f32d3d7a561941aba12f5679be4b4010 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230208f32d3d7a561941aba12f5679be4b4010 2023-02-08 02:56:58,291 INFO [Listener at localhost.localdomain/44017] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/.tmp/f1/150dcb565bd1460f939bc0e1e18d4674 2023-02-08 02:56:58,296 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/.tmp/f1/150dcb565bd1460f939bc0e1e18d4674 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674 2023-02-08 02:56:58,300 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674, entries=1, sequenceid=5, filesize=4.9 K 2023-02-08 02:56:58,301 INFO [Listener at localhost.localdomain/44017] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 3c30914da1cf136d80bae962b3fdcb81 in 430ms, sequenceid=5, compaction requested=false 2023-02-08 02:56:58,301 DEBUG [Listener at localhost.localdomain/44017] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-02-08 02:56:58,301 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegion(2445): Flush status journal for 3c30914da1cf136d80bae962b3fdcb81: 2023-02-08 02:56:58,303 INFO [Listener at localhost.localdomain/44017] regionserver.HRegion(2744): Flushing 3c30914da1cf136d80bae962b3fdcb81 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-08 02:56:58,721 INFO [Listener at localhost.localdomain/44017] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302082416e9c696a843ceae7aca0cb4c69310 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202302082416e9c696a843ceae7aca0cb4c69310 2023-02-08 02:56:58,796 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 02:56:59,127 INFO [Listener at localhost.localdomain/44017] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/.tmp/f1/fc1baf198d9e4400a6e5a1d3793896f7 2023-02-08 02:56:59,132 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/.tmp/f1/fc1baf198d9e4400a6e5a1d3793896f7 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7 2023-02-08 02:56:59,138 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7, entries=1, sequenceid=9, filesize=4.9 K 2023-02-08 02:56:59,139 INFO [Listener at localhost.localdomain/44017] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 3c30914da1cf136d80bae962b3fdcb81 in 836ms, sequenceid=9, compaction requested=false 2023-02-08 02:56:59,139 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegion(2445): Flush status journal for 3c30914da1cf136d80bae962b3fdcb81: 2023-02-08 02:56:59,140 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-02-08 02:56:59,142 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-08 02:56:59,143 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-08 02:56:59,144 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675825619143 2023-02-08 02:56:59,144 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:56:59,144 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-08 02:56:59,145 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-02-08 02:56:59,145 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-02-08 02:56:59,145 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] zookeeper.ReadOnlyZKClient(139): Connect 0x6773e6ef to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:56:59,192 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,192 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,212 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@369e1260, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:56:59,213 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230208 for table='testGetAfterCompaction' and column='f1' 2023-02-08 02:56:59,243 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,243 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,294 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,294 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,346 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,346 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,398 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,398 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,450 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,450 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,495 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-08 02:56:59,495 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-02-08 02:56:59,502 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,503 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,554 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,554 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,606 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,606 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,657 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,658 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,709 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,709 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,761 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,761 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,813 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,813 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,865 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,866 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,917 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,918 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,970 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:56:59,970 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,022 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,022 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,054 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208946cc6720a8742c8b794d1f3e2439f78 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230208946cc6720a8742c8b794d1f3e2439f78 2023-02-08 02:57:00,056 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230208 table='testGetAfterCompaction' column='f1' 2023-02-08 02:57:00,070 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 02:57:00,071 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:52674, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 02:57:00,073 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,073 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,076 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:00,076 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:00,077 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 02:57:00,079 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:42464, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 02:57:00,087 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230208/f1/b2e1178bcdf04991864eef18d9c9f6d0 first=Optional[r1] last=Optional[r2] 2023-02-08 02:57:00,088 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row with hfile group [{f1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230208/f1/b2e1178bcdf04991864eef18d9c9f6d0}] 2023-02-08 02:57:00,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230208/f1/b2e1178bcdf04991864eef18d9c9f6d0 for inclusion in 3c30914da1cf136d80bae962b3fdcb81/f1 2023-02-08 02:57:00,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-08 02:57:00,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 02:57:00,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for 3c30914da1cf136d80bae962b3fdcb81: 2023-02-08 02:57:00,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230208/f1/b2e1178bcdf04991864eef18d9c9f6d0 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testGetAfterCompaction__ere9nrtcaenvj3ncrvsbd4adpi8fin21dhu1hh7groq0u8bt15mhkgsfa0iukj27/f1/b2e1178bcdf04991864eef18d9c9f6d0 2023-02-08 02:57:00,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testGetAfterCompaction__ere9nrtcaenvj3ncrvsbd4adpi8fin21dhu1hh7groq0u8bt15mhkgsfa0iukj27/f1/b2e1178bcdf04991864eef18d9c9f6d0 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_ 2023-02-08 02:57:00,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testGetAfterCompaction__ere9nrtcaenvj3ncrvsbd4adpi8fin21dhu1hh7groq0u8bt15mhkgsfa0iukj27/f1/b2e1178bcdf04991864eef18d9c9f6d0 into 3c30914da1cf136d80bae962b3fdcb81/f1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_ - updating store file list. 2023-02-08 02:57:00,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_ into 3c30914da1cf136d80bae962b3fdcb81/f1 2023-02-08 02:57:00,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testGetAfterCompaction__ere9nrtcaenvj3ncrvsbd4adpi8fin21dhu1hh7groq0u8bt15mhkgsfa0iukj27/f1/b2e1178bcdf04991864eef18d9c9f6d0 into 3c30914da1cf136d80bae962b3fdcb81/f1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_) 2023-02-08 02:57:00,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testGetAfterCompaction__ere9nrtcaenvj3ncrvsbd4adpi8fin21dhu1hh7groq0u8bt15mhkgsfa0iukj27/f1/b2e1178bcdf04991864eef18d9c9f6d0 2023-02-08 02:57:00,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(1912): 3c30914da1cf136d80bae962b3fdcb81/f1 is initiating minor compaction 2023-02-08 02:57:00,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@336c6ba6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:57:00,104 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 3c30914da1cf136d80bae962b3fdcb81/f1 in testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81. 2023-02-08 02:57:00,104 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/.tmp, totalSize=10.0 K 2023-02-08 02:57:00,104 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting fc1baf198d9e4400a6e5a1d3793896f7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-08 02:57:00,104 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-08 02:57:00,106 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230208 table='testGetAfterCompaction' column='f1' 2023-02-08 02:57:00,107 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:00,108 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202302082416e9c696a843ceae7aca0cb4c69310 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202302082416e9c696a843ceae7aca0cb4c69310 2023-02-08 02:57:00,109 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230208f32d3d7a561941aba12f5679be4b4010 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230208f32d3d7a561941aba12f5679be4b4010 2023-02-08 02:57:00,109 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-02-08 02:57:00,109 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230208' 2023-02-08 02:57:00,109 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230208 for table='testGetAfterCompaction' and column='f1' 2023-02-08 02:57:00,109 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-02-08 02:57:00,109 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:57:00,110 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-08 02:57:00,111 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 969 msec 2023-02-08 02:57:00,112 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3c30914da1cf136d80bae962b3fdcb81#f1#compaction#77 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-08 02:57:00,124 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,124 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675825020043; access_time=1675825019228; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 02:57:00,124 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,128 DEBUG [Listener at localhost.localdomain/44017] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 02:57:00,131 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:52686, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 02:57:00,132 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44577] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81. 2023-02-08 02:57:00,132 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44577] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-02-08 02:57:00,133 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44577] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-08 02:57:00,133 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44577] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-08 02:57:00,133 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44577] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81. because compaction request was cancelled 2023-02-08 02:57:00,185 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,185 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675825020043; access_time=1675825019228; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 02:57:00,185 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,236 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,236 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675825020043; access_time=1675825019228; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 02:57:00,237 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,288 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,288 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675825020043; access_time=1675825019228; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 02:57:00,289 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,340 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,341 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675825020043; access_time=1675825019228; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 02:57:00,341 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,392 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,392 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675825020043; access_time=1675825019228; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 02:57:00,392 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,443 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,444 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675825020043; access_time=1675825019228; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 02:57:00,444 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,495 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,496 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675825020043; access_time=1675825019228; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 02:57:00,496 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,547 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,547 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675825020043; access_time=1675825019228; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 02:57:00,548 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,599 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,599 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675825020043; access_time=1675825019228; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 02:57:00,599 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,651 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,652 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675825020043; access_time=1675825019228; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 02:57:00,652 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,704 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,704 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675825020043; access_time=1675825019228; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 02:57:00,704 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,756 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,756 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675825020043; access_time=1675825019228; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 02:57:00,756 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,808 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,808 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675825020043; access_time=1675825019228; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 02:57:00,809 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,860 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,861 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675825020043; access_time=1675825019228; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 02:57:00,861 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,913 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,913 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675825020043; access_time=1675825019228; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 02:57:00,913 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,940 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/.tmp/f1/d1bff5c57f2a4bca94176973c8620e6d as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/d1bff5c57f2a4bca94176973c8620e6d 2023-02-08 02:57:00,948 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 3c30914da1cf136d80bae962b3fdcb81/f1 of 3c30914da1cf136d80bae962b3fdcb81 into d1bff5c57f2a4bca94176973c8620e6d(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 02:57:00,948 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 3c30914da1cf136d80bae962b3fdcb81: 2023-02-08 02:57:00,948 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1675825020104; duration=0sec 2023-02-08 02:57:00,948 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:57:00,964 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,964 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675825020043; access_time=1675825019228; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 02:57:00,964 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/d1bff5c57f2a4bca94176973c8620e6d; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1675825020927; access_time=1675825020110; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:00,964 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:01,018 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_] to archive 2023-02-08 02:57:01,018 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:01,019 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675825020043; access_time=1675825019228; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 02:57:01,019 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/d1bff5c57f2a4bca94176973c8620e6d; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1675825020927; access_time=1675825020110; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:01,019 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825019127; access_time=1675825018304; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:01,019 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:01,022 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/fc1baf198d9e4400a6e5a1d3793896f7 2023-02-08 02:57:01,025 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_ to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/3b6878b6b0a74c1aaa6ce494611c5290_SeqId_12_ 2023-02-08 02:57:01,070 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675825018290; access_time=1675825017874; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:01,071 INFO [Listener at localhost.localdomain/44017] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/d1bff5c57f2a4bca94176973c8620e6d; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1675825020927; access_time=1675825020110; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 02:57:01,198 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:01,198 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:01,199 INFO [Listener at localhost.localdomain/44017] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-02-08 02:57:01,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.HMaster$11(2405): Client=jenkins//136.243.104.168 disable testGetAfterCompaction 2023-02-08 02:57:01,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-02-08 02:57:01,212 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675825021212"}]},"ts":"1675825021212"} 2023-02-08 02:57:01,212 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:01,212 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:01,213 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-02-08 02:57:01,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-08 02:57:01,274 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-02-08 02:57:01,278 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=3c30914da1cf136d80bae962b3fdcb81, UNASSIGN}] 2023-02-08 02:57:01,280 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=3c30914da1cf136d80bae962b3fdcb81, UNASSIGN 2023-02-08 02:57:01,282 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=3c30914da1cf136d80bae962b3fdcb81, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:01,282 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675825021281"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675825021281"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675825021281"}]},"ts":"1675825021281"} 2023-02-08 02:57:01,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 3c30914da1cf136d80bae962b3fdcb81, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:57:01,313 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:01,313 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:01,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-08 02:57:01,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close 3c30914da1cf136d80bae962b3fdcb81 2023-02-08 02:57:01,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 3c30914da1cf136d80bae962b3fdcb81, disabling compactions & flushes 2023-02-08 02:57:01,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81. 2023-02-08 02:57:01,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81. 2023-02-08 02:57:01,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81. after waiting 0 ms 2023-02-08 02:57:01,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81. 2023-02-08 02:57:01,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-08 02:57:01,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-08 02:57:01,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81. 2023-02-08 02:57:01,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 3c30914da1cf136d80bae962b3fdcb81: Waiting for close lock at 1675825021439Running coprocessor pre-close hooks at 1675825021439Disabling compacts and flushes for region at 1675825021439Disabling writes for close at 1675825021439Writing region close event to WAL at 1675825021445 (+6 ms)Running coprocessor post-close hooks at 1675825021450 (+5 ms)Closed at 1675825021451 (+1 ms) 2023-02-08 02:57:01,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed 3c30914da1cf136d80bae962b3fdcb81 2023-02-08 02:57:01,454 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=3c30914da1cf136d80bae962b3fdcb81, regionState=CLOSED 2023-02-08 02:57:01,454 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675825021454"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675825021454"}]},"ts":"1675825021454"} 2023-02-08 02:57:01,457 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-02-08 02:57:01,457 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 3c30914da1cf136d80bae962b3fdcb81, server=jenkins-hbase12.apache.org,44577,1675824910652 in 171 msec 2023-02-08 02:57:01,458 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-02-08 02:57:01,458 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=3c30914da1cf136d80bae962b3fdcb81, UNASSIGN in 179 msec 2023-02-08 02:57:01,459 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675825021459"}]},"ts":"1675825021459"} 2023-02-08 02:57:01,460 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-02-08 02:57:01,464 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-02-08 02:57:01,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 258 msec 2023-02-08 02:57:01,514 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:01,515 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:01,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-08 02:57:01,516 INFO [Listener at localhost.localdomain/44017] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-02-08 02:57:01,516 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:01,517 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:01,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.HMaster$5(2215): Client=jenkins//136.243.104.168 delete testGetAfterCompaction 2023-02-08 02:57:01,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-02-08 02:57:01,532 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-08 02:57:01,533 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-08 02:57:01,534 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:01,534 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:01,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-08 02:57:01,539 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81 2023-02-08 02:57:01,542 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1, FileablePath, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/recovered.edits] 2023-02-08 02:57:01,545 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/150dcb565bd1460f939bc0e1e18d4674 2023-02-08 02:57:01,546 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/d1bff5c57f2a4bca94176973c8620e6d to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/f1/d1bff5c57f2a4bca94176973c8620e6d 2023-02-08 02:57:01,549 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/recovered.edits/15.seqid to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81/recovered.edits/15.seqid 2023-02-08 02:57:01,549 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testGetAfterCompaction/3c30914da1cf136d80bae962b3fdcb81 2023-02-08 02:57:01,549 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-08 02:57:01,549 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-08 02:57:01,550 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-02-08 02:57:01,553 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230208946cc6720a8742c8b794d1f3e2439f78 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230208946cc6720a8742c8b794d1f3e2439f78 2023-02-08 02:57:01,553 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-08 02:57:01,555 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-08 02:57:01,573 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-02-08 02:57:01,576 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-02-08 02:57:01,577 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-08 02:57:01,577 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-02-08 02:57:01,578 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675825021577"}]},"ts":"9223372036854775807"} 2023-02-08 02:57:01,579 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-08 02:57:01,579 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3c30914da1cf136d80bae962b3fdcb81, NAME => 'testGetAfterCompaction,,1675825015742.3c30914da1cf136d80bae962b3fdcb81.', STARTKEY => '', ENDKEY => ''}] 2023-02-08 02:57:01,579 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-02-08 02:57:01,579 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675825021579"}]},"ts":"9223372036854775807"} 2023-02-08 02:57:01,581 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-02-08 02:57:01,591 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-08 02:57:01,592 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 68 msec 2023-02-08 02:57:01,635 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:01,635 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:01,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-08 02:57:01,636 INFO [Listener at localhost.localdomain/44017] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-02-08 02:57:01,649 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=235 (was 249), OpenFileDescriptor=596 (was 635), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=115 (was 126), ProcessCount=172 (was 172), AvailableMemoryMB=3331 (was 3396) 2023-02-08 02:57:01,658 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=235, OpenFileDescriptor=596, MaxFileDescriptor=60000, SystemLoadAverage=115, ProcessCount=172, AvailableMemoryMB=3331 2023-02-08 02:57:01,659 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:01,659 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:01,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-08 02:57:01,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-02-08 02:57:01,662 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 02:57:01,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-02-08 02:57:01,662 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:01,662 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 02:57:01,662 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:01,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-08 02:57:01,664 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9 2023-02-08 02:57:01,665 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c 2023-02-08 02:57:01,665 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1 2023-02-08 02:57:01,665 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9 empty. 2023-02-08 02:57:01,665 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c empty. 2023-02-08 02:57:01,665 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1 empty. 2023-02-08 02:57:01,665 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9 2023-02-08 02:57:01,665 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c 2023-02-08 02:57:01,665 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1 2023-02-08 02:57:01,665 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-02-08 02:57:01,763 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:01,763 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:01,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-08 02:57:01,965 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:01,965 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:01,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-08 02:57:02,079 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-08 02:57:02,082 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9b6734a6d08c30735bfd45bd3735f0e9, NAME => 'testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp 2023-02-08 02:57:02,082 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7671): creating {ENCODED => 903c5e7f299e5714b7640c3c91b635f1, NAME => 'testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp 2023-02-08 02:57:02,083 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7671): creating {ENCODED => 12373e98d6fb3636c0d02a5815aad09c, NAME => 'testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp 2023-02-08 02:57:02,268 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:02,268 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:02,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-08 02:57:02,491 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:57:02,491 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:57:02,491 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:57:02,491 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1603): Closing 9b6734a6d08c30735bfd45bd3735f0e9, disabling compactions & flushes 2023-02-08 02:57:02,492 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1603): Closing 12373e98d6fb3636c0d02a5815aad09c, disabling compactions & flushes 2023-02-08 02:57:02,492 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:02,492 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:02,492 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. after waiting 0 ms 2023-02-08 02:57:02,492 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:02,492 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:02,491 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1603): Closing 903c5e7f299e5714b7640c3c91b635f1, disabling compactions & flushes 2023-02-08 02:57:02,492 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1557): Region close journal for 12373e98d6fb3636c0d02a5815aad09c: Waiting for close lock at 1675825022492Disabling compacts and flushes for region at 1675825022492Disabling writes for close at 1675825022492Writing region close event to WAL at 1675825022492Closed at 1675825022492 2023-02-08 02:57:02,492 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:02,492 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:02,493 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:02,493 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. after waiting 0 ms 2023-02-08 02:57:02,493 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:02,493 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:02,493 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:02,493 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. after waiting 0 ms 2023-02-08 02:57:02,493 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1557): Region close journal for 903c5e7f299e5714b7640c3c91b635f1: Waiting for close lock at 1675825022491Disabling compacts and flushes for region at 1675825022491Disabling writes for close at 1675825022493 (+2 ms)Writing region close event to WAL at 1675825022493Closed at 1675825022493 2023-02-08 02:57:02,493 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:02,494 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:02,494 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1557): Region close journal for 9b6734a6d08c30735bfd45bd3735f0e9: Waiting for close lock at 1675825022491Disabling compacts and flushes for region at 1675825022491Disabling writes for close at 1675825022493 (+2 ms)Writing region close event to WAL at 1675825022494 (+1 ms)Closed at 1675825022494 2023-02-08 02:57:02,498 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 02:57:02,500 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675825022500"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675825022500"}]},"ts":"1675825022500"} 2023-02-08 02:57:02,501 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675825022500"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675825022500"}]},"ts":"1675825022500"} 2023-02-08 02:57:02,501 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675825022500"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675825022500"}]},"ts":"1675825022500"} 2023-02-08 02:57:02,503 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-08 02:57:02,504 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 02:57:02,504 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675825022504"}]},"ts":"1675825022504"} 2023-02-08 02:57:02,505 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-08 02:57:02,561 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9b6734a6d08c30735bfd45bd3735f0e9, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=12373e98d6fb3636c0d02a5815aad09c, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=903c5e7f299e5714b7640c3c91b635f1, ASSIGN}] 2023-02-08 02:57:02,565 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=903c5e7f299e5714b7640c3c91b635f1, ASSIGN 2023-02-08 02:57:02,565 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=12373e98d6fb3636c0d02a5815aad09c, ASSIGN 2023-02-08 02:57:02,566 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9b6734a6d08c30735bfd45bd3735f0e9, ASSIGN 2023-02-08 02:57:02,567 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=903c5e7f299e5714b7640c3c91b635f1, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=false 2023-02-08 02:57:02,567 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=12373e98d6fb3636c0d02a5815aad09c, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=false 2023-02-08 02:57:02,567 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9b6734a6d08c30735bfd45bd3735f0e9, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=false 2023-02-08 02:57:02,721 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=12373e98d6fb3636c0d02a5815aad09c, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:02,721 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=903c5e7f299e5714b7640c3c91b635f1, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:02,721 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=9b6734a6d08c30735bfd45bd3735f0e9, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:02,722 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675825022721"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675825022721"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675825022721"}]},"ts":"1675825022721"} 2023-02-08 02:57:02,722 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675825022721"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675825022721"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675825022721"}]},"ts":"1675825022721"} 2023-02-08 02:57:02,722 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675825022721"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675825022721"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675825022721"}]},"ts":"1675825022721"} 2023-02-08 02:57:02,725 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=81, state=RUNNABLE; OpenRegionProcedure 12373e98d6fb3636c0d02a5815aad09c, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:57:02,725 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=82, state=RUNNABLE; OpenRegionProcedure 903c5e7f299e5714b7640c3c91b635f1, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:57:02,728 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=80, state=RUNNABLE; OpenRegionProcedure 9b6734a6d08c30735bfd45bd3735f0e9, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:57:02,771 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:02,771 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:02,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-08 02:57:02,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:02,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9b6734a6d08c30735bfd45bd3735f0e9, NAME => 'testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9.', STARTKEY => '', ENDKEY => '1'} 2023-02-08 02:57:02,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 9b6734a6d08c30735bfd45bd3735f0e9 2023-02-08 02:57:02,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:57:02,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 9b6734a6d08c30735bfd45bd3735f0e9 2023-02-08 02:57:02,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 9b6734a6d08c30735bfd45bd3735f0e9 2023-02-08 02:57:02,888 INFO [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9b6734a6d08c30735bfd45bd3735f0e9 2023-02-08 02:57:02,891 DEBUG [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1 2023-02-08 02:57:02,891 DEBUG [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1 2023-02-08 02:57:02,892 INFO [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b6734a6d08c30735bfd45bd3735f0e9 columnFamilyName family1 2023-02-08 02:57:02,895 INFO [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] regionserver.HStore(310): Store=9b6734a6d08c30735bfd45bd3735f0e9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:57:02,895 INFO [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9b6734a6d08c30735bfd45bd3735f0e9 2023-02-08 02:57:02,897 DEBUG [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2 2023-02-08 02:57:02,898 DEBUG [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2 2023-02-08 02:57:02,898 INFO [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b6734a6d08c30735bfd45bd3735f0e9 columnFamilyName family2 2023-02-08 02:57:02,899 INFO [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] regionserver.HStore(310): Store=9b6734a6d08c30735bfd45bd3735f0e9/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:57:02,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9 2023-02-08 02:57:02,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9 2023-02-08 02:57:02,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 02:57:02,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 9b6734a6d08c30735bfd45bd3735f0e9 2023-02-08 02:57:02,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:57:02,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 9b6734a6d08c30735bfd45bd3735f0e9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73428497, jitterRate=0.09416987001895905}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 02:57:02,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 9b6734a6d08c30735bfd45bd3735f0e9: Running coprocessor pre-open hook at 1675825022885Writing region info on filesystem at 1675825022885Initializing all the Stores at 1675825022887 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825022887Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825022888 (+1 ms)Cleaning up temporary data from old regions at 1675825022901 (+13 ms)Cleaning up detritus from prior splits at 1675825022902 (+1 ms)Running coprocessor post-open hooks at 1675825022906 (+4 ms)Region opened successfully at 1675825022906 2023-02-08 02:57:02,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9., pid=85, masterSystemTime=1675825022878 2023-02-08 02:57:02,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:02,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:02,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:02,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 12373e98d6fb3636c0d02a5815aad09c, NAME => 'testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c.', STARTKEY => '1', ENDKEY => '2'} 2023-02-08 02:57:02,909 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=9b6734a6d08c30735bfd45bd3735f0e9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:02,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 12373e98d6fb3636c0d02a5815aad09c 2023-02-08 02:57:02,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:57:02,909 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675825022909"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675825022909"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675825022909"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675825022909"}]},"ts":"1675825022909"} 2023-02-08 02:57:02,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 12373e98d6fb3636c0d02a5815aad09c 2023-02-08 02:57:02,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 12373e98d6fb3636c0d02a5815aad09c 2023-02-08 02:57:02,910 INFO [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 12373e98d6fb3636c0d02a5815aad09c 2023-02-08 02:57:02,912 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=80 2023-02-08 02:57:02,912 DEBUG [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1 2023-02-08 02:57:02,912 DEBUG [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1 2023-02-08 02:57:02,912 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=80, state=SUCCESS; OpenRegionProcedure 9b6734a6d08c30735bfd45bd3735f0e9, server=jenkins-hbase12.apache.org,44577,1675824910652 in 184 msec 2023-02-08 02:57:02,913 INFO [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12373e98d6fb3636c0d02a5815aad09c columnFamilyName family1 2023-02-08 02:57:02,913 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9b6734a6d08c30735bfd45bd3735f0e9, ASSIGN in 353 msec 2023-02-08 02:57:02,914 INFO [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] regionserver.HStore(310): Store=12373e98d6fb3636c0d02a5815aad09c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:57:02,914 INFO [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 12373e98d6fb3636c0d02a5815aad09c 2023-02-08 02:57:02,915 DEBUG [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2 2023-02-08 02:57:02,915 DEBUG [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2 2023-02-08 02:57:02,916 INFO [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12373e98d6fb3636c0d02a5815aad09c columnFamilyName family2 2023-02-08 02:57:02,917 INFO [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] regionserver.HStore(310): Store=12373e98d6fb3636c0d02a5815aad09c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:57:02,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c 2023-02-08 02:57:02,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c 2023-02-08 02:57:02,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 02:57:02,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 12373e98d6fb3636c0d02a5815aad09c 2023-02-08 02:57:02,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:57:02,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 12373e98d6fb3636c0d02a5815aad09c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67127496, jitterRate=2.7763843536376953E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 02:57:02,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 12373e98d6fb3636c0d02a5815aad09c: Running coprocessor pre-open hook at 1675825022909Writing region info on filesystem at 1675825022909Initializing all the Stores at 1675825022910 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825022910Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825022910Cleaning up temporary data from old regions at 1675825022919 (+9 ms)Cleaning up detritus from prior splits at 1675825022919Running coprocessor post-open hooks at 1675825022924 (+5 ms)Region opened successfully at 1675825022924 2023-02-08 02:57:02,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c., pid=83, masterSystemTime=1675825022878 2023-02-08 02:57:02,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:02,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:02,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:02,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 903c5e7f299e5714b7640c3c91b635f1, NAME => 'testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1.', STARTKEY => '2', ENDKEY => ''} 2023-02-08 02:57:02,927 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=12373e98d6fb3636c0d02a5815aad09c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:02,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 903c5e7f299e5714b7640c3c91b635f1 2023-02-08 02:57:02,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:57:02,927 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675825022927"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675825022927"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675825022927"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675825022927"}]},"ts":"1675825022927"} 2023-02-08 02:57:02,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 903c5e7f299e5714b7640c3c91b635f1 2023-02-08 02:57:02,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 903c5e7f299e5714b7640c3c91b635f1 2023-02-08 02:57:02,929 INFO [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 903c5e7f299e5714b7640c3c91b635f1 2023-02-08 02:57:02,931 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=81 2023-02-08 02:57:02,931 DEBUG [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1 2023-02-08 02:57:02,931 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=81, state=SUCCESS; OpenRegionProcedure 12373e98d6fb3636c0d02a5815aad09c, server=jenkins-hbase12.apache.org,44577,1675824910652 in 204 msec 2023-02-08 02:57:02,931 DEBUG [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1 2023-02-08 02:57:02,931 INFO [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 903c5e7f299e5714b7640c3c91b635f1 columnFamilyName family1 2023-02-08 02:57:02,932 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=12373e98d6fb3636c0d02a5815aad09c, ASSIGN in 372 msec 2023-02-08 02:57:02,932 INFO [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] regionserver.HStore(310): Store=903c5e7f299e5714b7640c3c91b635f1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:57:02,932 INFO [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 903c5e7f299e5714b7640c3c91b635f1 2023-02-08 02:57:02,933 DEBUG [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2 2023-02-08 02:57:02,933 DEBUG [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2 2023-02-08 02:57:02,934 INFO [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 903c5e7f299e5714b7640c3c91b635f1 columnFamilyName family2 2023-02-08 02:57:02,934 INFO [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] regionserver.HStore(310): Store=903c5e7f299e5714b7640c3c91b635f1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:57:02,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1 2023-02-08 02:57:02,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1 2023-02-08 02:57:02,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 02:57:02,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 903c5e7f299e5714b7640c3c91b635f1 2023-02-08 02:57:02,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:57:02,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 903c5e7f299e5714b7640c3c91b635f1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70132769, jitterRate=0.0450596958398819}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 02:57:02,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 903c5e7f299e5714b7640c3c91b635f1: Running coprocessor pre-open hook at 1675825022928Writing region info on filesystem at 1675825022928Initializing all the Stores at 1675825022928Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825022929 (+1 ms)Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825022929Cleaning up temporary data from old regions at 1675825022936 (+7 ms)Cleaning up detritus from prior splits at 1675825022936Running coprocessor post-open hooks at 1675825022939 (+3 ms)Region opened successfully at 1675825022939 2023-02-08 02:57:02,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1., pid=84, masterSystemTime=1675825022878 2023-02-08 02:57:02,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:02,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:02,941 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=903c5e7f299e5714b7640c3c91b635f1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:02,941 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675825022941"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675825022941"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675825022941"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675825022941"}]},"ts":"1675825022941"} 2023-02-08 02:57:02,943 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=82 2023-02-08 02:57:02,943 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=82, state=SUCCESS; OpenRegionProcedure 903c5e7f299e5714b7640c3c91b635f1, server=jenkins-hbase12.apache.org,44577,1675824910652 in 217 msec 2023-02-08 02:57:02,945 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=79 2023-02-08 02:57:02,945 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=903c5e7f299e5714b7640c3c91b635f1, ASSIGN in 382 msec 2023-02-08 02:57:02,945 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 02:57:02,946 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675825022945"}]},"ts":"1675825022945"} 2023-02-08 02:57:02,947 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-08 02:57:02,959 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 02:57:02,960 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2990 sec 2023-02-08 02:57:03,772 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:03,772 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:03,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-08 02:57:03,775 INFO [Listener at localhost.localdomain/44017] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-02-08 02:57:03,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:03,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:03,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:03,790 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:03,790 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:03,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:57:03,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-08 02:57:03,792 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-08 02:57:03,792 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:03,792 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-08 02:57:03,792 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-08 02:57:03,793 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:03,793 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:03,843 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:03,843 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:03,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:03,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:03,843 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:03,844 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:57:03,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:03,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:03,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:57:03,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:03,845 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-08 02:57:03,845 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-08 02:57:03,845 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-08 02:57:03,845 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:03,846 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-08 02:57:03,846 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:03,846 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. started... 2023-02-08 02:57:03,846 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:03,846 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 02:57:03,847 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:03,847 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. started... 2023-02-08 02:57:03,847 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:57:03,847 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 12373e98d6fb3636c0d02a5815aad09c 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-08 02:57:03,846 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. started... 2023-02-08 02:57:03,848 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9b6734a6d08c30735bfd45bd3735f0e9 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-08 02:57:03,849 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 903c5e7f299e5714b7640c3c91b635f1 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-08 02:57:03,863 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208fb0cde7d75254f838f6d87d16d755d49 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208fb0cde7d75254f838f6d87d16d755d49 2023-02-08 02:57:04,269 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family1/05d45fa5b0704cd699922167246d4cd0 2023-02-08 02:57:04,272 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208f249b02e92304f509f6beea9cb102a37 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208f249b02e92304f509f6beea9cb102a37 2023-02-08 02:57:04,272 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208a194b2886199442282b4ff0e357620d1 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208a194b2886199442282b4ff0e357620d1 2023-02-08 02:57:04,278 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family1/572417a992924edd9957eb1d317e11cd 2023-02-08 02:57:04,286 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family1/50f7399a4dcf439196b9fe8cd2fc65e7 2023-02-08 02:57:04,294 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020814e6c41b1a35418a893d40e802e57095 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020814e6c41b1a35418a893d40e802e57095 2023-02-08 02:57:04,294 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020893649b1a3d1d4eb08c996b04a45f2b83 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023020893649b1a3d1d4eb08c996b04a45f2b83 2023-02-08 02:57:04,699 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family2/928cc4c90d034ecb865bc59f9c995a98 2023-02-08 02:57:04,699 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family2/b1187445590d4db3a7dfe57576d45090 2023-02-08 02:57:04,707 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208534527c541b94e9495b68744da745a62 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208534527c541b94e9495b68744da745a62 2023-02-08 02:57:04,708 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family1/05d45fa5b0704cd699922167246d4cd0 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/05d45fa5b0704cd699922167246d4cd0 2023-02-08 02:57:04,708 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family1/572417a992924edd9957eb1d317e11cd as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/572417a992924edd9957eb1d317e11cd 2023-02-08 02:57:04,712 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/572417a992924edd9957eb1d317e11cd, entries=4, sequenceid=5, filesize=5.4 K 2023-02-08 02:57:04,712 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/05d45fa5b0704cd699922167246d4cd0, entries=4, sequenceid=5, filesize=5.4 K 2023-02-08 02:57:04,713 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family2/b1187445590d4db3a7dfe57576d45090 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/b1187445590d4db3a7dfe57576d45090 2023-02-08 02:57:04,713 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family2/928cc4c90d034ecb865bc59f9c995a98 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/928cc4c90d034ecb865bc59f9c995a98 2023-02-08 02:57:04,713 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family2/bbd943ef42be4b8e9e1f390166f32a71 2023-02-08 02:57:04,716 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/b1187445590d4db3a7dfe57576d45090, entries=2, sequenceid=5, filesize=5.1 K 2023-02-08 02:57:04,716 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/928cc4c90d034ecb865bc59f9c995a98, entries=2, sequenceid=5, filesize=5.1 K 2023-02-08 02:57:04,717 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family1/50f7399a4dcf439196b9fe8cd2fc65e7 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/50f7399a4dcf439196b9fe8cd2fc65e7 2023-02-08 02:57:04,717 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 12373e98d6fb3636c0d02a5815aad09c in 870ms, sequenceid=5, compaction requested=false 2023-02-08 02:57:04,717 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 9b6734a6d08c30735bfd45bd3735f0e9 in 869ms, sequenceid=5, compaction requested=false 2023-02-08 02:57:04,717 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-08 02:57:04,717 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-08 02:57:04,718 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 12373e98d6fb3636c0d02a5815aad09c: 2023-02-08 02:57:04,718 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9b6734a6d08c30735bfd45bd3735f0e9: 2023-02-08 02:57:04,718 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:04,718 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:04,718 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 02:57:04,718 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 02:57:04,721 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/50f7399a4dcf439196b9fe8cd2fc65e7, entries=4, sequenceid=5, filesize=5.4 K 2023-02-08 02:57:04,721 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family2/bbd943ef42be4b8e9e1f390166f32a71 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/bbd943ef42be4b8e9e1f390166f32a71 2023-02-08 02:57:04,724 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/bbd943ef42be4b8e9e1f390166f32a71, entries=2, sequenceid=5, filesize=5.1 K 2023-02-08 02:57:04,725 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 903c5e7f299e5714b7640c3c91b635f1 in 876ms, sequenceid=5, compaction requested=false 2023-02-08 02:57:04,725 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 903c5e7f299e5714b7640c3c91b635f1: 2023-02-08 02:57:04,725 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:04,725 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 02:57:04,725 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 02:57:04,725 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:04,726 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-08 02:57:04,726 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-08 02:57:04,737 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:04,737 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:04,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:04,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:04,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:04,738 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:04,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:04,738 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:57:04,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:04,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:04,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:04,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:04,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-08 02:57:04,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@655b4366[Count = 0] remaining members to acquire global barrier 2023-02-08 02:57:04,739 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-08 02:57:04,739 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:04,748 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:04,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:04,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:04,748 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-08 02:57:04,748 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-08 02:57:04,748 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:57:04,748 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:04,748 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:57:04,758 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-08 02:57:04,758 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:04,758 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-08 02:57:04,758 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:04,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:04,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:04,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:04,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:04,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:04,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:04,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:04,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:04,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:04,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:04,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:57:04,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-08 02:57:04,762 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-08 02:57:04,762 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:57:04,762 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:57:04,763 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-08 02:57:04,763 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:57:04,843 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:04,843 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:04,843 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:04,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:04,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:04,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:04,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:04,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:04,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:04,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:04,845 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:04,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:04,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:04,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:04,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:04,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:04,850 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:04,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:04,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:04,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:04,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:04,863 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:04,863 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:04,864 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:04,864 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:04,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-08 02:57:04,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:57:04,863 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:04,864 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:04,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:04,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:04,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-08 02:57:04,864 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:04,864 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-08 02:57:04,864 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:57:04,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:04,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:04,864 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:04,865 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:04,865 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:04,965 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:57:04,965 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:04,965 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:04,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:57:04,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:04,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:04,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:04,969 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:04,969 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:04,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:57:04,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-08 02:57:04,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-08 02:57:04,972 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-08 02:57:04,972 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:04,972 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-08 02:57:04,972 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-08 02:57:04,972 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:04,972 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:04,979 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:04,979 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:04,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:04,980 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:04,980 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:57:04,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:04,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:04,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:57:04,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:04,980 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-08 02:57:04,981 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-08 02:57:04,981 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-08 02:57:04,981 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-08 02:57:04,981 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:04,981 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-08 02:57:04,981 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:04,981 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:04,981 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. started... 2023-02-08 02:57:04,981 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. started... 2023-02-08 02:57:04,981 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 903c5e7f299e5714b7640c3c91b635f1 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-08 02:57:04,981 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 12373e98d6fb3636c0d02a5815aad09c 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-08 02:57:04,982 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 02:57:04,982 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:57:04,982 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:04,982 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. started... 2023-02-08 02:57:04,982 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9b6734a6d08c30735bfd45bd3735f0e9 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-08 02:57:05,410 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302083b0c47ca4c3c415595ff61688d27604f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302083b0c47ca4c3c415595ff61688d27604f 2023-02-08 02:57:05,410 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208c1546cb71c164793acead2f5a9ecc4b9 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208c1546cb71c164793acead2f5a9ecc4b9 2023-02-08 02:57:05,410 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302086d9a7bcab1264e5a94d350c136fe2526 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302086d9a7bcab1264e5a94d350c136fe2526 2023-02-08 02:57:05,816 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family1/4408b3d2330549328be2f2cd48bba925 2023-02-08 02:57:05,816 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family1/74ebb73f89444c198ac38e137c8ae954 2023-02-08 02:57:05,816 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family1/f1caa80c1620447d8d23991baa2c637d 2023-02-08 02:57:06,242 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208ec999d99a4b542138d8a1f3e2297d7ff to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230208ec999d99a4b542138d8a1f3e2297d7ff 2023-02-08 02:57:06,243 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208c789ab5a3e5f4e2aa9c010c3afad88ac to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208c789ab5a3e5f4e2aa9c010c3afad88ac 2023-02-08 02:57:06,243 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020841795392be9341ceaa3c3845aaa7604b to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020841795392be9341ceaa3c3845aaa7604b 2023-02-08 02:57:06,248 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family2/a9ce54357a1041f880875e4caf9dd161 2023-02-08 02:57:06,251 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family1/f1caa80c1620447d8d23991baa2c637d as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/f1caa80c1620447d8d23991baa2c637d 2023-02-08 02:57:06,255 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/f1caa80c1620447d8d23991baa2c637d, entries=4, sequenceid=9, filesize=5.4 K 2023-02-08 02:57:06,256 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family2/a9ce54357a1041f880875e4caf9dd161 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/a9ce54357a1041f880875e4caf9dd161 2023-02-08 02:57:06,259 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/a9ce54357a1041f880875e4caf9dd161, entries=2, sequenceid=9, filesize=5.1 K 2023-02-08 02:57:06,260 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 903c5e7f299e5714b7640c3c91b635f1 in 1279ms, sequenceid=9, compaction requested=false 2023-02-08 02:57:06,260 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 903c5e7f299e5714b7640c3c91b635f1: 2023-02-08 02:57:06,260 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:06,260 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 02:57:06,649 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family2/1261fadd0f6a42388a2307485b8ece65 2023-02-08 02:57:06,649 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family2/85cfdba51b0e4e10a82b14a5c1ae483b 2023-02-08 02:57:06,657 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family1/74ebb73f89444c198ac38e137c8ae954 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/74ebb73f89444c198ac38e137c8ae954 2023-02-08 02:57:06,658 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family1/4408b3d2330549328be2f2cd48bba925 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/4408b3d2330549328be2f2cd48bba925 2023-02-08 02:57:06,664 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/74ebb73f89444c198ac38e137c8ae954, entries=4, sequenceid=9, filesize=5.4 K 2023-02-08 02:57:06,664 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/4408b3d2330549328be2f2cd48bba925, entries=4, sequenceid=9, filesize=5.4 K 2023-02-08 02:57:06,665 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family2/1261fadd0f6a42388a2307485b8ece65 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/1261fadd0f6a42388a2307485b8ece65 2023-02-08 02:57:06,665 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family2/85cfdba51b0e4e10a82b14a5c1ae483b as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/85cfdba51b0e4e10a82b14a5c1ae483b 2023-02-08 02:57:06,670 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/85cfdba51b0e4e10a82b14a5c1ae483b, entries=2, sequenceid=9, filesize=5.1 K 2023-02-08 02:57:06,670 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/1261fadd0f6a42388a2307485b8ece65, entries=2, sequenceid=9, filesize=5.1 K 2023-02-08 02:57:06,671 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 9b6734a6d08c30735bfd45bd3735f0e9 in 1689ms, sequenceid=9, compaction requested=false 2023-02-08 02:57:06,671 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 12373e98d6fb3636c0d02a5815aad09c in 1690ms, sequenceid=9, compaction requested=false 2023-02-08 02:57:06,671 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9b6734a6d08c30735bfd45bd3735f0e9: 2023-02-08 02:57:06,672 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 12373e98d6fb3636c0d02a5815aad09c: 2023-02-08 02:57:06,672 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:06,672 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:06,672 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 02:57:06,672 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 02:57:06,672 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 02:57:06,672 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:06,672 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-08 02:57:06,672 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-08 02:57:06,684 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:06,684 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:06,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:06,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:06,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:06,685 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:06,685 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:57:06,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:06,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:06,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:06,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:06,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:06,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-08 02:57:06,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3818b7d9[Count = 0] remaining members to acquire global barrier 2023-02-08 02:57:06,689 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-08 02:57:06,689 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:06,695 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:06,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:06,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:06,695 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-08 02:57:06,695 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-08 02:57:06,695 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:57:06,696 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:06,696 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:57:06,706 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-08 02:57:06,706 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:06,706 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:06,706 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-08 02:57:06,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:06,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:06,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:06,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:06,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:06,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:06,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:06,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:06,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:06,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:06,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:57:06,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-08 02:57:06,714 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-08 02:57:06,715 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:57:06,715 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:57:06,715 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-08 02:57:06,715 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:57:06,727 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:06,727 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:06,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:06,727 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:06,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:06,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:06,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:06,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:06,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:06,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:06,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:06,728 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:06,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:06,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:06,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:06,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:06,731 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:06,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:06,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:06,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:06,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:06,737 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:06,737 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:06,737 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:06,737 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:06,737 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:06,737 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:06,737 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:06,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-08 02:57:06,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:57:06,738 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:06,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-08 02:57:06,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:06,737 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:06,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:06,738 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:06,738 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-08 02:57:06,738 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:57:06,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:06,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:06,838 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:57:06,839 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:06,839 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:06,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:57:06,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:06,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:06,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:06,848 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:06,848 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:06,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:57:06,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-08 02:57:06,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-08 02:57:06,852 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-08 02:57:06,852 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:06,852 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-08 02:57:06,852 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-08 02:57:06,852 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:06,852 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:06,863 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:06,863 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:06,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:06,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:06,864 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:06,864 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:57:06,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:06,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:06,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:57:06,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:06,864 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-08 02:57:06,864 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-08 02:57:06,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-08 02:57:06,865 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-08 02:57:06,865 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:06,865 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-08 02:57:06,865 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:06,865 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:06,865 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. started... 2023-02-08 02:57:06,865 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 02:57:06,865 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:57:06,865 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:06,865 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 12373e98d6fb3636c0d02a5815aad09c 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-08 02:57:06,865 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. started... 2023-02-08 02:57:06,865 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. started... 2023-02-08 02:57:06,865 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 903c5e7f299e5714b7640c3c91b635f1 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-08 02:57:06,865 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9b6734a6d08c30735bfd45bd3735f0e9 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-08 02:57:06,955 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 02:57:07,305 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208efbe5934e4f048bebf5ddcd5da7d15f0 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208efbe5934e4f048bebf5ddcd5da7d15f0 2023-02-08 02:57:07,306 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020850a5b5a2593a4e958246e5e0bec02dd5 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020850a5b5a2593a4e958246e5e0bec02dd5 2023-02-08 02:57:07,305 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302082abfaffeee9d47f4b7a06bf1946c7473 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302082abfaffeee9d47f4b7a06bf1946c7473 2023-02-08 02:57:07,713 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family1/dcd3aca6561e4731a8a12ee6f7fc1a94 2023-02-08 02:57:07,713 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family1/3fe0ab37fbdd48999b8451a603110632 2023-02-08 02:57:07,713 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family1/bc906f7bf326433f8c5843320d441c07 2023-02-08 02:57:08,138 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020818548b0f8a26462487e62c5efc3248bd to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023020818548b0f8a26462487e62c5efc3248bd 2023-02-08 02:57:08,138 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208fa2e306be45d437eb8d6c07df5a7a538 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208fa2e306be45d437eb8d6c07df5a7a538 2023-02-08 02:57:08,138 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208a336d25cc0f74c0f993b7c0ed944f3db to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230208a336d25cc0f74c0f993b7c0ed944f3db 2023-02-08 02:57:08,144 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family2/a435d5cb4c88407f999a36ad8c766a28 2023-02-08 02:57:08,148 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family1/dcd3aca6561e4731a8a12ee6f7fc1a94 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/dcd3aca6561e4731a8a12ee6f7fc1a94 2023-02-08 02:57:08,151 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/dcd3aca6561e4731a8a12ee6f7fc1a94, entries=4, sequenceid=13, filesize=5.4 K 2023-02-08 02:57:08,152 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family2/a435d5cb4c88407f999a36ad8c766a28 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/a435d5cb4c88407f999a36ad8c766a28 2023-02-08 02:57:08,155 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/a435d5cb4c88407f999a36ad8c766a28, entries=2, sequenceid=13, filesize=5.1 K 2023-02-08 02:57:08,156 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 9b6734a6d08c30735bfd45bd3735f0e9 in 1291ms, sequenceid=13, compaction requested=true 2023-02-08 02:57:08,156 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9b6734a6d08c30735bfd45bd3735f0e9: 2023-02-08 02:57:08,156 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:08,156 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 02:57:08,545 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family2/e0d003e600d74b55b221352e281d07b9 2023-02-08 02:57:08,545 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family2/2647224f0b9c40f4ae812131560548d9 2023-02-08 02:57:08,555 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family1/3fe0ab37fbdd48999b8451a603110632 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/3fe0ab37fbdd48999b8451a603110632 2023-02-08 02:57:08,556 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family1/bc906f7bf326433f8c5843320d441c07 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/bc906f7bf326433f8c5843320d441c07 2023-02-08 02:57:08,561 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/3fe0ab37fbdd48999b8451a603110632, entries=4, sequenceid=13, filesize=5.4 K 2023-02-08 02:57:08,561 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/bc906f7bf326433f8c5843320d441c07, entries=4, sequenceid=13, filesize=5.4 K 2023-02-08 02:57:08,562 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family2/e0d003e600d74b55b221352e281d07b9 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/e0d003e600d74b55b221352e281d07b9 2023-02-08 02:57:08,562 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family2/2647224f0b9c40f4ae812131560548d9 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/2647224f0b9c40f4ae812131560548d9 2023-02-08 02:57:08,567 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/2647224f0b9c40f4ae812131560548d9, entries=2, sequenceid=13, filesize=5.1 K 2023-02-08 02:57:08,567 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/e0d003e600d74b55b221352e281d07b9, entries=2, sequenceid=13, filesize=5.1 K 2023-02-08 02:57:08,567 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 12373e98d6fb3636c0d02a5815aad09c in 1702ms, sequenceid=13, compaction requested=true 2023-02-08 02:57:08,567 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 903c5e7f299e5714b7640c3c91b635f1 in 1702ms, sequenceid=13, compaction requested=true 2023-02-08 02:57:08,567 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 12373e98d6fb3636c0d02a5815aad09c: 2023-02-08 02:57:08,567 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 903c5e7f299e5714b7640c3c91b635f1: 2023-02-08 02:57:08,567 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:08,567 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:08,568 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 02:57:08,568 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 02:57:08,568 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 02:57:08,568 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:08,568 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-08 02:57:08,568 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-08 02:57:08,632 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:08,632 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:08,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:08,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:08,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:08,633 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:08,633 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:57:08,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:08,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:08,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:08,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:08,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:08,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-08 02:57:08,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ff4e6c9[Count = 0] remaining members to acquire global barrier 2023-02-08 02:57:08,637 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-08 02:57:08,637 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:08,671 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:08,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:08,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:08,671 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-08 02:57:08,671 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-08 02:57:08,671 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:57:08,671 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:08,672 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:57:08,695 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-08 02:57:08,696 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:08,695 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:08,696 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-08 02:57:08,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:08,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:08,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:08,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:08,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:08,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:08,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:08,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:08,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:08,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:08,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:57:08,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-08 02:57:08,706 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-08 02:57:08,706 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:57:08,706 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:57:08,706 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-08 02:57:08,706 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:57:08,716 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:08,716 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:08,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:08,716 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:08,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:08,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:08,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:08,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:08,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:08,717 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:08,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:08,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:08,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:08,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:08,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:08,719 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:08,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:08,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:08,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:08,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:08,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:08,726 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:08,726 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:08,726 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:08,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:08,727 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:08,726 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:08,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:08,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-08 02:57:08,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:57:08,727 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:08,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-08 02:57:08,727 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:08,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:08,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:08,727 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:08,727 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:08,727 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:08,727 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-08 02:57:08,727 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:57:08,827 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:57:08,828 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:08,828 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:08,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:57:08,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:08,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:08,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:08,837 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:08,837 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:08,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:57:08,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-08 02:57:08,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-08 02:57:08,841 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-08 02:57:08,842 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:08,842 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-08 02:57:08,842 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-08 02:57:08,842 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:08,842 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:08,853 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:08,853 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:08,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:08,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:08,853 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:08,853 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:57:08,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:08,854 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:08,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:57:08,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:08,854 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-08 02:57:08,855 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-08 02:57:08,855 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-08 02:57:08,855 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-08 02:57:08,855 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:08,855 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-08 02:57:08,855 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:08,855 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. started... 2023-02-08 02:57:08,855 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:08,855 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. started... 2023-02-08 02:57:08,855 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 12373e98d6fb3636c0d02a5815aad09c 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-08 02:57:08,855 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 02:57:08,855 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:57:08,855 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 903c5e7f299e5714b7640c3c91b635f1 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-08 02:57:08,855 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:08,855 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. started... 2023-02-08 02:57:08,855 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9b6734a6d08c30735bfd45bd3735f0e9 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-08 02:57:08,874 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302085df9d34cb6554b4fa10790c14470f5e4 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302085df9d34cb6554b4fa10790c14470f5e4 2023-02-08 02:57:09,278 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family1/eb2c7dbb4f14414f8338b35f68b559fa 2023-02-08 02:57:09,280 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208a9cce4b809f844d5a20945726625d298 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208a9cce4b809f844d5a20945726625d298 2023-02-08 02:57:09,281 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020864f2f309fbcf47d3ba43dfd77a0618eb to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020864f2f309fbcf47d3ba43dfd77a0618eb 2023-02-08 02:57:09,295 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family1/0f553be334ff447186e0f65865546c5b 2023-02-08 02:57:09,495 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-08 02:57:09,694 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family1/3c3fa3a23f91414183577cd2042f12eb 2023-02-08 02:57:09,706 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208b58f009ea8ba44779faffd18f30ab17e to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208b58f009ea8ba44779faffd18f30ab17e 2023-02-08 02:57:09,709 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302084386c3016e5e414d8af89d8abc052249 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302084386c3016e5e414d8af89d8abc052249 2023-02-08 02:57:09,714 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family2/73a5743093994defa790b7b6a5f2d19f 2023-02-08 02:57:09,717 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family1/eb2c7dbb4f14414f8338b35f68b559fa as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/eb2c7dbb4f14414f8338b35f68b559fa 2023-02-08 02:57:09,720 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/eb2c7dbb4f14414f8338b35f68b559fa, entries=4, sequenceid=17, filesize=5.4 K 2023-02-08 02:57:09,721 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family2/73a5743093994defa790b7b6a5f2d19f as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/73a5743093994defa790b7b6a5f2d19f 2023-02-08 02:57:09,725 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/73a5743093994defa790b7b6a5f2d19f, entries=2, sequenceid=17, filesize=5.1 K 2023-02-08 02:57:09,726 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 9b6734a6d08c30735bfd45bd3735f0e9 in 871ms, sequenceid=17, compaction requested=true 2023-02-08 02:57:09,726 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9b6734a6d08c30735bfd45bd3735f0e9: 2023-02-08 02:57:09,726 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:09,726 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 02:57:10,115 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family2/ed556adc1747418f9d870d3e64080608 2023-02-08 02:57:10,124 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020856b9d137eb24440a8cef7dac03a6da0e to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020856b9d137eb24440a8cef7dac03a6da0e 2023-02-08 02:57:10,125 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family1/0f553be334ff447186e0f65865546c5b as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/0f553be334ff447186e0f65865546c5b 2023-02-08 02:57:10,129 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/0f553be334ff447186e0f65865546c5b, entries=4, sequenceid=17, filesize=5.4 K 2023-02-08 02:57:10,130 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family2/ed556adc1747418f9d870d3e64080608 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/ed556adc1747418f9d870d3e64080608 2023-02-08 02:57:10,134 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/ed556adc1747418f9d870d3e64080608, entries=2, sequenceid=17, filesize=5.1 K 2023-02-08 02:57:10,135 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 903c5e7f299e5714b7640c3c91b635f1 in 1280ms, sequenceid=17, compaction requested=true 2023-02-08 02:57:10,135 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 903c5e7f299e5714b7640c3c91b635f1: 2023-02-08 02:57:10,135 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:10,135 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 02:57:10,531 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family2/29aa81036d3b45c7a1fc8d92d034bdbd 2023-02-08 02:57:10,544 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family1/3c3fa3a23f91414183577cd2042f12eb as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/3c3fa3a23f91414183577cd2042f12eb 2023-02-08 02:57:10,550 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/3c3fa3a23f91414183577cd2042f12eb, entries=4, sequenceid=17, filesize=5.4 K 2023-02-08 02:57:10,551 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family2/29aa81036d3b45c7a1fc8d92d034bdbd as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/29aa81036d3b45c7a1fc8d92d034bdbd 2023-02-08 02:57:10,555 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/29aa81036d3b45c7a1fc8d92d034bdbd, entries=2, sequenceid=17, filesize=5.1 K 2023-02-08 02:57:10,556 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 12373e98d6fb3636c0d02a5815aad09c in 1701ms, sequenceid=17, compaction requested=true 2023-02-08 02:57:10,556 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 12373e98d6fb3636c0d02a5815aad09c: 2023-02-08 02:57:10,556 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:10,556 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 02:57:10,557 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 02:57:10,557 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:10,557 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-08 02:57:10,557 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-08 02:57:10,663 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:10,663 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:10,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:10,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:10,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:10,664 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:10,664 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:57:10,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:10,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:10,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:10,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:10,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:10,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-08 02:57:10,665 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-08 02:57:10,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@423f2026[Count = 0] remaining members to acquire global barrier 2023-02-08 02:57:10,665 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:10,674 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:10,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:10,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:10,674 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-08 02:57:10,674 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-08 02:57:10,674 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:57:10,674 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:10,674 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:57:10,684 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-08 02:57:10,684 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:10,684 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:10,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:10,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:10,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:10,684 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-08 02:57:10,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:10,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:10,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:10,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:10,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:10,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:10,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:10,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:57:10,686 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-08 02:57:10,686 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:57:10,686 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:57:10,686 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-08 02:57:10,686 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-08 02:57:10,686 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:57:10,695 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:10,695 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:10,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:10,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:10,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:10,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:10,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:10,695 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:10,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:10,695 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:10,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:10,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:10,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:10,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:10,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:10,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:10,696 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:10,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:10,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:10,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:10,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:10,705 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:10,705 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:10,705 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:10,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-08 02:57:10,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:57:10,706 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:10,705 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:10,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:10,706 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:10,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:10,706 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-08 02:57:10,706 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:10,706 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:57:10,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-08 02:57:10,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:10,706 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:10,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:10,706 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:10,706 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:10,806 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:57:10,806 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:10,806 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:10,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:57:10,818 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:10,818 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:10,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1580): Client=jenkins//136.243.104.168 snapshot request for:{ ss=snaptb-1675825030808 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-08 02:57:10,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675825030820 (current time:1675825030821). 2023-02-08 02:57:10,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-08 02:57:10,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] zookeeper.ReadOnlyZKClient(139): Connect 0x43289373 to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:57:10,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4de986e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:57:10,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 02:57:10,839 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:45120, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 02:57:10,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43289373 to 127.0.0.1:49602 2023-02-08 02:57:10,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:57:10,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-08 02:57:10,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1675825030808 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-08 02:57:10,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-08 02:57:10,852 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-08 02:57:10,852 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1675825630852 2023-02-08 02:57:10,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1675825030808 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-08 02:57:10,853 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1675825030808 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-08 02:57:10,854 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-08 02:57:10,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-08 02:57:10,855 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-02-08 02:57:10,856 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-08 02:57:10,856 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1675825630856 2023-02-08 02:57:10,859 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1675825030808 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-08 02:57:10,859 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-08 02:57:10,959 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 02:57:10,960 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:10,960 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:10,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675825030808 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 02:57:10,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675825030808 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-08 02:57:10,967 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-08 02:57:11,167 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 02:57:11,167 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:11,167 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:11,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675825030808 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 02:57:11,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675825030808 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-08 02:57:11,170 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-08 02:57:11,267 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1675825030808 2023-02-08 02:57:11,268 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1675825030808' 2023-02-08 02:57:11,268 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 02:57:11,268 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1675825030808' starting 'acquire' 2023-02-08 02:57:11,268 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1675825030808', kicking off acquire phase on members. 2023-02-08 02:57:11,270 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1675825030808 2023-02-08 02:57:11,270 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1675825030808 2023-02-08 02:57:11,284 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1675825030808/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:11,284 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 02:57:11,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 02:57:11,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 02:57:11,285 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1675825030808/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:11,285 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:57:11,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1675825030808 2023-02-08 02:57:11,285 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1675825030808 2023-02-08 02:57:11,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-08 02:57:11,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1675825030808 2023-02-08 02:57:11,286 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1675825030808 from table testCompactionWithHFileLink type FLUSH 2023-02-08 02:57:11,287 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1675825030808 2023-02-08 02:57:11,287 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1675825030808' with timeout 300000ms 2023-02-08 02:57:11,288 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 02:57:11,288 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1675825030808' starting 'acquire' stage 2023-02-08 02:57:11,288 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1675825030808' locally acquired 2023-02-08 02:57:11,288 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (snaptb-1675825030808) in zk 2023-02-08 02:57:11,295 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675825030808/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:11,295 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1675825030808 2023-02-08 02:57:11,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1675825030808/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:11,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:11,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 02:57:11,295 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1675825030808 2023-02-08 02:57:11,295 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1675825030808' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:57:11,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:11,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:11,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675825030808 2023-02-08 02:57:11,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:11,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:11,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'snaptb-1675825030808' on coordinator 2023-02-08 02:57:11,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d400b74[Count = 0] remaining members to acquire global barrier 2023-02-08 02:57:11,297 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1675825030808' starting 'in-barrier' execution. 2023-02-08 02:57:11,297 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1675825030808 2023-02-08 02:57:11,305 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675825030808 2023-02-08 02:57:11,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1675825030808 2023-02-08 02:57:11,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1675825030808 2023-02-08 02:57:11,306 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1675825030808' received 'reached' from coordinator. 2023-02-08 02:57:11,306 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1675825030808/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:11,306 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:57:11,307 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:11,307 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:11,307 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-02-08 02:57:11,307 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:11,307 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-08 02:57:11,307 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. started... 2023-02-08 02:57:11,307 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. started... 2023-02-08 02:57:11,307 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. started... 2023-02-08 02:57:11,307 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 9b6734a6d08c30735bfd45bd3735f0e9: 2023-02-08 02:57:11,307 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 903c5e7f299e5714b7640c3c91b635f1: 2023-02-08 02:57:11,307 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 12373e98d6fb3636c0d02a5815aad09c: 2023-02-08 02:57:11,308 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9.' region-info for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,308 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1.' region-info for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,308 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c.' region-info for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,314 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 02:57:11,314 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 02:57:11,314 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 02:57:11,318 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/05d45fa5b0704cd699922167246d4cd0, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/4408b3d2330549328be2f2cd48bba925, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/bc906f7bf326433f8c5843320d441c07, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/3c3fa3a23f91414183577cd2042f12eb] hfiles 2023-02-08 02:57:11,318 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/50f7399a4dcf439196b9fe8cd2fc65e7, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/f1caa80c1620447d8d23991baa2c637d, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/3fe0ab37fbdd48999b8451a603110632, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/0f553be334ff447186e0f65865546c5b] hfiles 2023-02-08 02:57:11,318 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/50f7399a4dcf439196b9fe8cd2fc65e7 for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,318 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/572417a992924edd9957eb1d317e11cd, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/74ebb73f89444c198ac38e137c8ae954, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/dcd3aca6561e4731a8a12ee6f7fc1a94, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/eb2c7dbb4f14414f8338b35f68b559fa] hfiles 2023-02-08 02:57:11,318 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/572417a992924edd9957eb1d317e11cd for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,318 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/05d45fa5b0704cd699922167246d4cd0 for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,437 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 02:57:11,437 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6773e6ef to 127.0.0.1:49602 2023-02-08 02:57:11,437 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:57:11,437 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/74ebb73f89444c198ac38e137c8ae954 for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,437 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/4408b3d2330549328be2f2cd48bba925 for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,437 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/dcd3aca6561e4731a8a12ee6f7fc1a94 for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,437 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/eb2c7dbb4f14414f8338b35f68b559fa for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,437 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/f1caa80c1620447d8d23991baa2c637d for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,437 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/3fe0ab37fbdd48999b8451a603110632 for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,437 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/bc906f7bf326433f8c5843320d441c07 for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,437 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/0f553be334ff447186e0f65865546c5b for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,437 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/b1187445590d4db3a7dfe57576d45090, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/1261fadd0f6a42388a2307485b8ece65, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/a435d5cb4c88407f999a36ad8c766a28, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/73a5743093994defa790b7b6a5f2d19f] hfiles 2023-02-08 02:57:11,438 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/b1187445590d4db3a7dfe57576d45090 for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,438 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/bbd943ef42be4b8e9e1f390166f32a71, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/a9ce54357a1041f880875e4caf9dd161, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/e0d003e600d74b55b221352e281d07b9, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/ed556adc1747418f9d870d3e64080608] hfiles 2023-02-08 02:57:11,438 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/3c3fa3a23f91414183577cd2042f12eb for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,438 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/bbd943ef42be4b8e9e1f390166f32a71 for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,438 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/928cc4c90d034ecb865bc59f9c995a98, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/85cfdba51b0e4e10a82b14a5c1ae483b, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/2647224f0b9c40f4ae812131560548d9, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/29aa81036d3b45c7a1fc8d92d034bdbd] hfiles 2023-02-08 02:57:11,438 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/928cc4c90d034ecb865bc59f9c995a98 for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,438 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/85cfdba51b0e4e10a82b14a5c1ae483b for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,438 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/1261fadd0f6a42388a2307485b8ece65 for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,438 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/2647224f0b9c40f4ae812131560548d9 for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,438 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/a9ce54357a1041f880875e4caf9dd161 for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,438 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/29aa81036d3b45c7a1fc8d92d034bdbd for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,438 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/a435d5cb4c88407f999a36ad8c766a28 for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,438 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/e0d003e600d74b55b221352e281d07b9 for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,438 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/ed556adc1747418f9d870d3e64080608 for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,438 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/73a5743093994defa790b7b6a5f2d19f for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,470 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 02:57:11,471 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:11,471 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:11,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675825030808 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 02:57:11,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675825030808 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-08 02:57:11,472 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-08 02:57:11,851 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. completed. 2023-02-08 02:57:11,851 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:11,851 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. completed. 2023-02-08 02:57:11,852 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:11,852 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. completed. 2023-02-08 02:57:11,852 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:11,853 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-02-08 02:57:11,853 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-02-08 02:57:11,853 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-02-08 02:57:11,853 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-02-08 02:57:11,853 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:11,853 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1675825030808' locally completed 2023-02-08 02:57:11,854 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1675825030808' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:57:11,863 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1675825030808' has notified controller of completion 2023-02-08 02:57:11,863 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:11,863 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675825030808/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:11,863 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1675825030808' completed. 2023-02-08 02:57:11,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1675825030808/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:11,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:11,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 02:57:11,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:11,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:11,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675825030808 2023-02-08 02:57:11,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:11,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:11,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675825030808 2023-02-08 02:57:11,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:11,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1675825030808' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:57:11,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'snaptb-1675825030808', counting down latch. Waiting for 0 more 2023-02-08 02:57:11,869 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1675825030808' execution completed 2023-02-08 02:57:11,870 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:57:11,870 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:57:11,870 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1675825030808 2023-02-08 02:57:11,870 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1675825030808including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-08 02:57:11,874 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1675825030808 2023-02-08 02:57:11,874 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1675825030808 2023-02-08 02:57:11,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1675825030808 2023-02-08 02:57:11,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:11,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 02:57:11,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1675825030808 2023-02-08 02:57:11,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1675825030808 2023-02-08 02:57:11,874 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 02:57:11,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:11,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 02:57:11,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 02:57:11,875 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1675825030808/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:11,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675825030808 2023-02-08 02:57:11,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1675825030808 2023-02-08 02:57:11,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:11,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675825030808 2023-02-08 02:57:11,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:11,878 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1675825030808/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:11,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:11,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675825030808 2023-02-08 02:57:11,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:11,884 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675825030808/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:11,884 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 02:57:11,884 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 02:57:11,884 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675825030808 2023-02-08 02:57:11,885 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1675825030808 2023-02-08 02:57:11,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1675825030808 because node does not exist (not an error) 2023-02-08 02:57:11,885 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-02-08 02:57:11,885 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675825030808 2023-02-08 02:57:11,885 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675825030808/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:11,885 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675825030808 2023-02-08 02:57:11,885 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:11,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 02:57:11,885 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675825030808 2023-02-08 02:57:11,885 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1675825030808 2023-02-08 02:57:11,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1675825030808 2023-02-08 02:57:11,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 02:57:11,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-02-08 02:57:11,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 02:57:11,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 02:57:11,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302082abfaffeee9d47f4b7a06bf1946c7473, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302083b0c47ca4c3c415595ff61688d27604f, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020864f2f309fbcf47d3ba43dfd77a0618eb, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208fb0cde7d75254f838f6d87d16d755d49, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020850a5b5a2593a4e958246e5e0bec02dd5, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208a194b2886199442282b4ff0e357620d1, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208a9cce4b809f844d5a20945726625d298, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208c1546cb71c164793acead2f5a9ecc4b9, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302085df9d34cb6554b4fa10790c14470f5e4, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302086d9a7bcab1264e5a94d350c136fe2526, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208efbe5934e4f048bebf5ddcd5da7d15f0, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208f249b02e92304f509f6beea9cb102a37] mob files 2023-02-08 02:57:11,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302082abfaffeee9d47f4b7a06bf1946c7473 2023-02-08 02:57:11,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302083b0c47ca4c3c415595ff61688d27604f 2023-02-08 02:57:11,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020864f2f309fbcf47d3ba43dfd77a0618eb 2023-02-08 02:57:11,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208fb0cde7d75254f838f6d87d16d755d49 2023-02-08 02:57:11,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020850a5b5a2593a4e958246e5e0bec02dd5 2023-02-08 02:57:11,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208a194b2886199442282b4ff0e357620d1 2023-02-08 02:57:11,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208a9cce4b809f844d5a20945726625d298 2023-02-08 02:57:11,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208c1546cb71c164793acead2f5a9ecc4b9 2023-02-08 02:57:11,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302085df9d34cb6554b4fa10790c14470f5e4 2023-02-08 02:57:11,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302086d9a7bcab1264e5a94d350c136fe2526 2023-02-08 02:57:11,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208efbe5934e4f048bebf5ddcd5da7d15f0 2023-02-08 02:57:11,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208f249b02e92304f509f6beea9cb102a37 2023-02-08 02:57:11,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020814e6c41b1a35418a893d40e802e57095, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020856b9d137eb24440a8cef7dac03a6da0e, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230208a336d25cc0f74c0f993b7c0ed944f3db, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230208ec999d99a4b542138d8a1f3e2297d7ff, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020841795392be9341ceaa3c3845aaa7604b, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302084386c3016e5e414d8af89d8abc052249, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208534527c541b94e9495b68744da745a62, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208fa2e306be45d437eb8d6c07df5a7a538, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023020818548b0f8a26462487e62c5efc3248bd, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023020893649b1a3d1d4eb08c996b04a45f2b83, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208b58f009ea8ba44779faffd18f30ab17e, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208c789ab5a3e5f4e2aa9c010c3afad88ac] mob files 2023-02-08 02:57:11,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020814e6c41b1a35418a893d40e802e57095 2023-02-08 02:57:11,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020856b9d137eb24440a8cef7dac03a6da0e 2023-02-08 02:57:11,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230208a336d25cc0f74c0f993b7c0ed944f3db 2023-02-08 02:57:11,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230208ec999d99a4b542138d8a1f3e2297d7ff 2023-02-08 02:57:11,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020841795392be9341ceaa3c3845aaa7604b 2023-02-08 02:57:11,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302084386c3016e5e414d8af89d8abc052249 2023-02-08 02:57:11,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208534527c541b94e9495b68744da745a62 2023-02-08 02:57:11,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208fa2e306be45d437eb8d6c07df5a7a538 2023-02-08 02:57:11,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023020818548b0f8a26462487e62c5efc3248bd 2023-02-08 02:57:11,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023020893649b1a3d1d4eb08c996b04a45f2b83 2023-02-08 02:57:11,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208b58f009ea8ba44779faffd18f30ab17e 2023-02-08 02:57:11,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208c789ab5a3e5f4e2aa9c010c3afad88ac 2023-02-08 02:57:11,972 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 02:57:11,972 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:11,972 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:11,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675825030808 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 02:57:11,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675825030808 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-08 02:57:11,975 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-08 02:57:12,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1675825030808 2023-02-08 02:57:12,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.hbase-snapshot/.tmp/snaptb-1675825030808 2023-02-08 02:57:12,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.hbase-snapshot/.tmp/snaptb-1675825030808 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.hbase-snapshot/snaptb-1675825030808 2023-02-08 02:57:12,814 DEBUG [regionserver/jenkins-hbase12:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.07692307692307693, tune throughput to 53.85 MB/second 2023-02-08 02:57:12,975 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 02:57:12,975 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:12,975 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:12,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675825030808 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 02:57:12,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675825030808 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-08 02:57:12,976 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-02-08 02:57:13,565 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1675825030808 of table testCompactionWithHFileLink completed 2023-02-08 02:57:13,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.hbase-snapshot/.tmp/snaptb-1675825030808 2023-02-08 02:57:13,567 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.hbase-snapshot/.tmp/snaptb-1675825030808 2023-02-08 02:57:13,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1675825030808 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1675825030853Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1675825032297 (+1444 ms)Consolidate snapshot: snaptb-1675825030808 at 1675825032297Loading Region manifests for snaptb-1675825030808 at 1675825032297Writing data manifest for snaptb-1675825030808 at 1675825032312 (+15 ms)Verifying snapshot: snaptb-1675825030808 at 1675825032718 (+406 ms)Snapshot snaptb-1675825030808 of table testCompactionWithHFileLink completed at 1675825033565 (+847 ms) 2023-02-08 02:57:13,569 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-08 02:57:13,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 2.7150 sec 2023-02-08 02:57:14,977 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 02:57:14,977 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:14,977 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:14,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675825030808 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 02:57:14,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1675825030808 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-08 02:57:14,998 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 02:57:15,018 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:15,018 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:15,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:57:15,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-08 02:57:15,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-08 02:57:15,021 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-08 02:57:15,021 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:15,021 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-08 02:57:15,021 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-08 02:57:15,021 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:15,021 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:15,126 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:15,126 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:15,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:15,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:15,128 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:15,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:15,128 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:57:15,129 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:15,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:57:15,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:15,130 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-08 02:57:15,130 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-08 02:57:15,130 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-08 02:57:15,130 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:15,131 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-08 02:57:15,131 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:15,131 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:15,131 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. started... 2023-02-08 02:57:15,131 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 02:57:15,132 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:57:15,131 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. started... 2023-02-08 02:57:15,132 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 903c5e7f299e5714b7640c3c91b635f1 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-08 02:57:15,131 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:15,132 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. started... 2023-02-08 02:57:15,132 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 12373e98d6fb3636c0d02a5815aad09c 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-08 02:57:15,132 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9b6734a6d08c30735bfd45bd3735f0e9 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-08 02:57:15,554 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family1/5b4b34ae719f4bc68f54aef1e39cfb6e 2023-02-08 02:57:15,560 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5b4b34ae719f4bc68f54aef1e39cfb6e 2023-02-08 02:57:15,959 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family1/80997f4cd5184cec8f75e20b1ff1ef7a 2023-02-08 02:57:15,959 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family1/cacb6fdbb1a5419b86663b555c364ef8 2023-02-08 02:57:15,968 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80997f4cd5184cec8f75e20b1ff1ef7a 2023-02-08 02:57:15,968 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cacb6fdbb1a5419b86663b555c364ef8 2023-02-08 02:57:15,976 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family2/9cb5e775a97747a3ae94ede3ca56f04e 2023-02-08 02:57:15,979 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9cb5e775a97747a3ae94ede3ca56f04e 2023-02-08 02:57:15,980 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family1/5b4b34ae719f4bc68f54aef1e39cfb6e as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/5b4b34ae719f4bc68f54aef1e39cfb6e 2023-02-08 02:57:15,983 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5b4b34ae719f4bc68f54aef1e39cfb6e 2023-02-08 02:57:15,983 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/5b4b34ae719f4bc68f54aef1e39cfb6e, entries=3, sequenceid=24, filesize=5.0 K 2023-02-08 02:57:15,984 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family2/9cb5e775a97747a3ae94ede3ca56f04e as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/9cb5e775a97747a3ae94ede3ca56f04e 2023-02-08 02:57:15,988 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9cb5e775a97747a3ae94ede3ca56f04e 2023-02-08 02:57:15,988 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/9cb5e775a97747a3ae94ede3ca56f04e, entries=1, sequenceid=24, filesize=5.0 K 2023-02-08 02:57:15,989 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 9b6734a6d08c30735bfd45bd3735f0e9 in 857ms, sequenceid=24, compaction requested=true 2023-02-08 02:57:15,989 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9b6734a6d08c30735bfd45bd3735f0e9: 2023-02-08 02:57:15,989 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:15,989 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 02:57:16,787 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family2/1663150d2f7346729c5514fb6f5375a9 2023-02-08 02:57:16,787 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family2/f17923b9ce3549a7a1f747b8fe381ffd 2023-02-08 02:57:16,794 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1663150d2f7346729c5514fb6f5375a9 2023-02-08 02:57:16,795 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f17923b9ce3549a7a1f747b8fe381ffd 2023-02-08 02:57:16,796 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family1/80997f4cd5184cec8f75e20b1ff1ef7a as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/80997f4cd5184cec8f75e20b1ff1ef7a 2023-02-08 02:57:16,796 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family1/cacb6fdbb1a5419b86663b555c364ef8 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/cacb6fdbb1a5419b86663b555c364ef8 2023-02-08 02:57:16,800 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80997f4cd5184cec8f75e20b1ff1ef7a 2023-02-08 02:57:16,800 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/80997f4cd5184cec8f75e20b1ff1ef7a, entries=3, sequenceid=24, filesize=5.0 K 2023-02-08 02:57:16,800 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cacb6fdbb1a5419b86663b555c364ef8 2023-02-08 02:57:16,800 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/cacb6fdbb1a5419b86663b555c364ef8, entries=3, sequenceid=24, filesize=5.0 K 2023-02-08 02:57:16,801 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family2/1663150d2f7346729c5514fb6f5375a9 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/1663150d2f7346729c5514fb6f5375a9 2023-02-08 02:57:16,801 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family2/f17923b9ce3549a7a1f747b8fe381ffd as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/f17923b9ce3549a7a1f747b8fe381ffd 2023-02-08 02:57:16,805 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1663150d2f7346729c5514fb6f5375a9 2023-02-08 02:57:16,805 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f17923b9ce3549a7a1f747b8fe381ffd 2023-02-08 02:57:16,806 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/1663150d2f7346729c5514fb6f5375a9, entries=1, sequenceid=24, filesize=5.0 K 2023-02-08 02:57:16,806 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/f17923b9ce3549a7a1f747b8fe381ffd, entries=1, sequenceid=24, filesize=5.0 K 2023-02-08 02:57:16,806 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 903c5e7f299e5714b7640c3c91b635f1 in 1674ms, sequenceid=24, compaction requested=true 2023-02-08 02:57:16,806 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 12373e98d6fb3636c0d02a5815aad09c in 1674ms, sequenceid=24, compaction requested=true 2023-02-08 02:57:16,806 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 903c5e7f299e5714b7640c3c91b635f1: 2023-02-08 02:57:16,806 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 12373e98d6fb3636c0d02a5815aad09c: 2023-02-08 02:57:16,806 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:16,806 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:16,807 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 02:57:16,807 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 02:57:16,807 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 02:57:16,807 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:16,807 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-08 02:57:16,807 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-08 02:57:17,073 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:17,073 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:17,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:17,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:17,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:17,074 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:17,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:17,074 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:57:17,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:17,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:17,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:17,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:17,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-08 02:57:17,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9bcd7a[Count = 0] remaining members to acquire global barrier 2023-02-08 02:57:17,081 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-08 02:57:17,082 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:17,095 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:17,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:17,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:17,095 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-08 02:57:17,095 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-08 02:57:17,095 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:57:17,095 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:17,096 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:57:17,105 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:17,105 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-08 02:57:17,106 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:17,106 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-08 02:57:17,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:17,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:17,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:17,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:17,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:17,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:17,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:17,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:17,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:17,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:17,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:57:17,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-08 02:57:17,116 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-08 02:57:17,116 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:57:17,116 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:57:17,116 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-08 02:57:17,116 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:57:17,126 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:17,126 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:17,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:17,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:17,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:17,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:17,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:17,126 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:17,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:17,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:17,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:17,127 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:17,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:17,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:17,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:17,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:17,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:17,131 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:17,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:17,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 02:57:17,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:17,137 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:17,137 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:17,137 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 02:57:17,137 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:17,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-08 02:57:17,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:57:17,137 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-08 02:57:17,137 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:17,137 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:17,137 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:17,137 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 02:57:17,138 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 02:57:17,137 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:17,137 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-08 02:57:17,138 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:57:17,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:17,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:17,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:17,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:17,238 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:57:17,238 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:17,239 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:17,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:57:17,242 DEBUG [Listener at localhost.localdomain/44017] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 02:57:17,243 DEBUG [Listener at localhost.localdomain/44017] regionserver.HStore(1912): 12373e98d6fb3636c0d02a5815aad09c/family1 is initiating major compaction (all files) 2023-02-08 02:57:17,243 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 02:57:17,243 INFO [Listener at localhost.localdomain/44017] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 02:57:17,244 INFO [Listener at localhost.localdomain/44017] regionserver.HRegion(2258): Starting compaction of 12373e98d6fb3636c0d02a5815aad09c/family1 in testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:17,244 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/05d45fa5b0704cd699922167246d4cd0, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/4408b3d2330549328be2f2cd48bba925, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/bc906f7bf326433f8c5843320d441c07, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/3c3fa3a23f91414183577cd2042f12eb, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/cacb6fdbb1a5419b86663b555c364ef8] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp, totalSize=26.7 K 2023-02-08 02:57:17,246 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 05d45fa5b0704cd699922167246d4cd0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825023788 2023-02-08 02:57:17,247 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 4408b3d2330549328be2f2cd48bba925, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825024967 2023-02-08 02:57:17,249 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting bc906f7bf326433f8c5843320d441c07, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825026844 2023-02-08 02:57:17,249 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 3c3fa3a23f91414183577cd2042f12eb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825028832 2023-02-08 02:57:17,250 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting cacb6fdbb1a5419b86663b555c364ef8, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-08 02:57:17,268 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareThroughputController(145): 12373e98d6fb3636c0d02a5815aad09c#family1#compaction#108 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:57:17,680 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230208e80f01536b534dcebe25f28e4f04e032_del 2023-02-08 02:57:17,681 INFO [Listener at localhost.localdomain/44017] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208e80f01536b534dcebe25f28e4f04e032_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208e80f01536b534dcebe25f28e4f04e032_del 2023-02-08 02:57:18,510 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e53ce900860743c8a4e36c57cd16f5dc 2023-02-08 02:57:18,512 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family1/e53ce900860743c8a4e36c57cd16f5dc as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/e53ce900860743c8a4e36c57cd16f5dc 2023-02-08 02:57:18,520 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e53ce900860743c8a4e36c57cd16f5dc 2023-02-08 02:57:18,521 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 12373e98d6fb3636c0d02a5815aad09c/family1 of 12373e98d6fb3636c0d02a5815aad09c into e53ce900860743c8a4e36c57cd16f5dc(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:57:18,521 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegion(2288): Compaction status journal for 12373e98d6fb3636c0d02a5815aad09c: 2023-02-08 02:57:18,521 DEBUG [Listener at localhost.localdomain/44017] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 02:57:18,521 DEBUG [Listener at localhost.localdomain/44017] regionserver.HStore(1912): 12373e98d6fb3636c0d02a5815aad09c/family2 is initiating major compaction (all files) 2023-02-08 02:57:18,522 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 02:57:18,522 INFO [Listener at localhost.localdomain/44017] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 02:57:18,523 INFO [Listener at localhost.localdomain/44017] regionserver.HRegion(2258): Starting compaction of 12373e98d6fb3636c0d02a5815aad09c/family2 in testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:18,523 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/928cc4c90d034ecb865bc59f9c995a98, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/85cfdba51b0e4e10a82b14a5c1ae483b, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/2647224f0b9c40f4ae812131560548d9, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/29aa81036d3b45c7a1fc8d92d034bdbd, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/f17923b9ce3549a7a1f747b8fe381ffd] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp, totalSize=25.4 K 2023-02-08 02:57:18,523 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 928cc4c90d034ecb865bc59f9c995a98, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825023788 2023-02-08 02:57:18,524 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 85cfdba51b0e4e10a82b14a5c1ae483b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825024967 2023-02-08 02:57:18,525 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 2647224f0b9c40f4ae812131560548d9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825026844 2023-02-08 02:57:18,526 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 29aa81036d3b45c7a1fc8d92d034bdbd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825028832 2023-02-08 02:57:18,526 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting f17923b9ce3549a7a1f747b8fe381ffd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-08 02:57:18,541 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareThroughputController(145): 12373e98d6fb3636c0d02a5815aad09c#family2#compaction#109 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:57:18,621 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/05d45fa5b0704cd699922167246d4cd0, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/4408b3d2330549328be2f2cd48bba925, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/bc906f7bf326433f8c5843320d441c07, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/3c3fa3a23f91414183577cd2042f12eb, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/cacb6fdbb1a5419b86663b555c364ef8] to archive 2023-02-08 02:57:18,623 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:18,626 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/05d45fa5b0704cd699922167246d4cd0 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/05d45fa5b0704cd699922167246d4cd0 2023-02-08 02:57:18,628 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/4408b3d2330549328be2f2cd48bba925 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/4408b3d2330549328be2f2cd48bba925 2023-02-08 02:57:18,630 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/bc906f7bf326433f8c5843320d441c07 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/bc906f7bf326433f8c5843320d441c07 2023-02-08 02:57:18,633 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/3c3fa3a23f91414183577cd2042f12eb to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/3c3fa3a23f91414183577cd2042f12eb 2023-02-08 02:57:18,635 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/cacb6fdbb1a5419b86663b555c364ef8 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/cacb6fdbb1a5419b86663b555c364ef8 2023-02-08 02:57:18,957 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302084767b68987664c498537a00abb6f4de6_del 2023-02-08 02:57:18,957 INFO [Listener at localhost.localdomain/44017] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302084767b68987664c498537a00abb6f4de6_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302084767b68987664c498537a00abb6f4de6_del 2023-02-08 02:57:19,787 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff84f49b79e348fa9f2b6bf794a9707b 2023-02-08 02:57:19,788 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family2/ff84f49b79e348fa9f2b6bf794a9707b as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/ff84f49b79e348fa9f2b6bf794a9707b 2023-02-08 02:57:19,792 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff84f49b79e348fa9f2b6bf794a9707b 2023-02-08 02:57:19,793 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 12373e98d6fb3636c0d02a5815aad09c/family2 of 12373e98d6fb3636c0d02a5815aad09c into ff84f49b79e348fa9f2b6bf794a9707b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:57:19,794 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegion(2288): Compaction status journal for 12373e98d6fb3636c0d02a5815aad09c: 2023-02-08 02:57:19,794 DEBUG [Listener at localhost.localdomain/44017] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 02:57:19,794 DEBUG [Listener at localhost.localdomain/44017] regionserver.HStore(1912): 903c5e7f299e5714b7640c3c91b635f1/family1 is initiating major compaction (all files) 2023-02-08 02:57:19,794 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 02:57:19,794 INFO [Listener at localhost.localdomain/44017] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 02:57:19,794 INFO [Listener at localhost.localdomain/44017] regionserver.HRegion(2258): Starting compaction of 903c5e7f299e5714b7640c3c91b635f1/family1 in testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:19,794 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/50f7399a4dcf439196b9fe8cd2fc65e7, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/f1caa80c1620447d8d23991baa2c637d, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/3fe0ab37fbdd48999b8451a603110632, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/0f553be334ff447186e0f65865546c5b, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/80997f4cd5184cec8f75e20b1ff1ef7a] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp, totalSize=26.7 K 2023-02-08 02:57:19,795 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 50f7399a4dcf439196b9fe8cd2fc65e7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825023788 2023-02-08 02:57:19,795 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting f1caa80c1620447d8d23991baa2c637d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825024967 2023-02-08 02:57:19,796 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 3fe0ab37fbdd48999b8451a603110632, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825026845 2023-02-08 02:57:19,796 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 0f553be334ff447186e0f65865546c5b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825028833 2023-02-08 02:57:19,796 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 80997f4cd5184cec8f75e20b1ff1ef7a, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-08 02:57:19,806 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareThroughputController(145): 903c5e7f299e5714b7640c3c91b635f1#family1#compaction#110 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:57:19,817 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/928cc4c90d034ecb865bc59f9c995a98, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/85cfdba51b0e4e10a82b14a5c1ae483b, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/2647224f0b9c40f4ae812131560548d9, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/29aa81036d3b45c7a1fc8d92d034bdbd, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/f17923b9ce3549a7a1f747b8fe381ffd] to archive 2023-02-08 02:57:19,817 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:19,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/928cc4c90d034ecb865bc59f9c995a98 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/928cc4c90d034ecb865bc59f9c995a98 2023-02-08 02:57:19,820 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/85cfdba51b0e4e10a82b14a5c1ae483b to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/85cfdba51b0e4e10a82b14a5c1ae483b 2023-02-08 02:57:19,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/2647224f0b9c40f4ae812131560548d9 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/2647224f0b9c40f4ae812131560548d9 2023-02-08 02:57:19,822 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/29aa81036d3b45c7a1fc8d92d034bdbd to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/29aa81036d3b45c7a1fc8d92d034bdbd 2023-02-08 02:57:19,823 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/f17923b9ce3549a7a1f747b8fe381ffd to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/f17923b9ce3549a7a1f747b8fe381ffd 2023-02-08 02:57:20,221 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230208c33ecbf5e63f4d36bbc07a80664932d6_del 2023-02-08 02:57:20,221 INFO [Listener at localhost.localdomain/44017] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208c33ecbf5e63f4d36bbc07a80664932d6_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208c33ecbf5e63f4d36bbc07a80664932d6_del 2023-02-08 02:57:21,049 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d9c5de2f7c204dca838b47d05d64ca04 2023-02-08 02:57:21,049 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family1/d9c5de2f7c204dca838b47d05d64ca04 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/d9c5de2f7c204dca838b47d05d64ca04 2023-02-08 02:57:21,053 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d9c5de2f7c204dca838b47d05d64ca04 2023-02-08 02:57:21,054 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 903c5e7f299e5714b7640c3c91b635f1/family1 of 903c5e7f299e5714b7640c3c91b635f1 into d9c5de2f7c204dca838b47d05d64ca04(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:57:21,054 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegion(2288): Compaction status journal for 903c5e7f299e5714b7640c3c91b635f1: 2023-02-08 02:57:21,054 DEBUG [Listener at localhost.localdomain/44017] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 02:57:21,054 DEBUG [Listener at localhost.localdomain/44017] regionserver.HStore(1912): 903c5e7f299e5714b7640c3c91b635f1/family2 is initiating major compaction (all files) 2023-02-08 02:57:21,054 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 02:57:21,054 INFO [Listener at localhost.localdomain/44017] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 02:57:21,055 INFO [Listener at localhost.localdomain/44017] regionserver.HRegion(2258): Starting compaction of 903c5e7f299e5714b7640c3c91b635f1/family2 in testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:21,055 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/bbd943ef42be4b8e9e1f390166f32a71, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/a9ce54357a1041f880875e4caf9dd161, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/e0d003e600d74b55b221352e281d07b9, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/ed556adc1747418f9d870d3e64080608, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/1663150d2f7346729c5514fb6f5375a9] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp, totalSize=25.4 K 2023-02-08 02:57:21,055 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting bbd943ef42be4b8e9e1f390166f32a71, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825023788 2023-02-08 02:57:21,056 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting a9ce54357a1041f880875e4caf9dd161, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825024967 2023-02-08 02:57:21,056 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting e0d003e600d74b55b221352e281d07b9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825026845 2023-02-08 02:57:21,056 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting ed556adc1747418f9d870d3e64080608, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825028833 2023-02-08 02:57:21,057 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 1663150d2f7346729c5514fb6f5375a9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-08 02:57:21,068 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareThroughputController(145): 903c5e7f299e5714b7640c3c91b635f1#family2#compaction#111 average throughput is 1.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:57:21,124 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/50f7399a4dcf439196b9fe8cd2fc65e7, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/f1caa80c1620447d8d23991baa2c637d, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/3fe0ab37fbdd48999b8451a603110632, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/0f553be334ff447186e0f65865546c5b, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/80997f4cd5184cec8f75e20b1ff1ef7a] to archive 2023-02-08 02:57:21,125 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:21,128 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/50f7399a4dcf439196b9fe8cd2fc65e7 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/50f7399a4dcf439196b9fe8cd2fc65e7 2023-02-08 02:57:21,129 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/f1caa80c1620447d8d23991baa2c637d to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/f1caa80c1620447d8d23991baa2c637d 2023-02-08 02:57:21,130 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/3fe0ab37fbdd48999b8451a603110632 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/3fe0ab37fbdd48999b8451a603110632 2023-02-08 02:57:21,132 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/0f553be334ff447186e0f65865546c5b to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/0f553be334ff447186e0f65865546c5b 2023-02-08 02:57:21,133 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/80997f4cd5184cec8f75e20b1ff1ef7a to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/80997f4cd5184cec8f75e20b1ff1ef7a 2023-02-08 02:57:21,483 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302080d4db9d9f74d447582bfe1a266d0607c_del 2023-02-08 02:57:21,483 INFO [Listener at localhost.localdomain/44017] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302080d4db9d9f74d447582bfe1a266d0607c_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302080d4db9d9f74d447582bfe1a266d0607c_del 2023-02-08 02:57:22,356 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 17f02504914f45a1ae4c141e36370a71 2023-02-08 02:57:22,359 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family2/17f02504914f45a1ae4c141e36370a71 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/17f02504914f45a1ae4c141e36370a71 2023-02-08 02:57:22,367 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 17f02504914f45a1ae4c141e36370a71 2023-02-08 02:57:22,368 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 903c5e7f299e5714b7640c3c91b635f1/family2 of 903c5e7f299e5714b7640c3c91b635f1 into 17f02504914f45a1ae4c141e36370a71(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:57:22,368 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegion(2288): Compaction status journal for 903c5e7f299e5714b7640c3c91b635f1: 2023-02-08 02:57:22,368 DEBUG [Listener at localhost.localdomain/44017] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 02:57:22,368 DEBUG [Listener at localhost.localdomain/44017] regionserver.HStore(1912): 9b6734a6d08c30735bfd45bd3735f0e9/family1 is initiating major compaction (all files) 2023-02-08 02:57:22,369 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 02:57:22,369 INFO [Listener at localhost.localdomain/44017] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 02:57:22,369 INFO [Listener at localhost.localdomain/44017] regionserver.HRegion(2258): Starting compaction of 9b6734a6d08c30735bfd45bd3735f0e9/family1 in testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:22,369 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/572417a992924edd9957eb1d317e11cd, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/74ebb73f89444c198ac38e137c8ae954, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/dcd3aca6561e4731a8a12ee6f7fc1a94, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/eb2c7dbb4f14414f8338b35f68b559fa, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/5b4b34ae719f4bc68f54aef1e39cfb6e] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp, totalSize=26.7 K 2023-02-08 02:57:22,370 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 572417a992924edd9957eb1d317e11cd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825023787 2023-02-08 02:57:22,371 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 74ebb73f89444c198ac38e137c8ae954, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825024966 2023-02-08 02:57:22,371 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting dcd3aca6561e4731a8a12ee6f7fc1a94, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825026843 2023-02-08 02:57:22,372 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting eb2c7dbb4f14414f8338b35f68b559fa, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825028832 2023-02-08 02:57:22,372 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 5b4b34ae719f4bc68f54aef1e39cfb6e, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-08 02:57:22,383 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareThroughputController(145): 9b6734a6d08c30735bfd45bd3735f0e9#family1#compaction#112 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:57:22,420 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/bbd943ef42be4b8e9e1f390166f32a71, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/a9ce54357a1041f880875e4caf9dd161, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/e0d003e600d74b55b221352e281d07b9, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/ed556adc1747418f9d870d3e64080608, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/1663150d2f7346729c5514fb6f5375a9] to archive 2023-02-08 02:57:22,421 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:22,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/bbd943ef42be4b8e9e1f390166f32a71 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/bbd943ef42be4b8e9e1f390166f32a71 2023-02-08 02:57:22,425 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/a9ce54357a1041f880875e4caf9dd161 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/a9ce54357a1041f880875e4caf9dd161 2023-02-08 02:57:22,427 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/e0d003e600d74b55b221352e281d07b9 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/e0d003e600d74b55b221352e281d07b9 2023-02-08 02:57:22,428 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/ed556adc1747418f9d870d3e64080608 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/ed556adc1747418f9d870d3e64080608 2023-02-08 02:57:22,430 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/1663150d2f7346729c5514fb6f5375a9 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/1663150d2f7346729c5514fb6f5375a9 2023-02-08 02:57:22,798 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230208acc55e7484d643dcb31660fdc7b76ed4_del 2023-02-08 02:57:22,799 INFO [Listener at localhost.localdomain/44017] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208acc55e7484d643dcb31660fdc7b76ed4_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208acc55e7484d643dcb31660fdc7b76ed4_del 2023-02-08 02:57:23,625 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f24d5c7364dc46a997a2341e39dfc76e 2023-02-08 02:57:23,627 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family1/f24d5c7364dc46a997a2341e39dfc76e as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/f24d5c7364dc46a997a2341e39dfc76e 2023-02-08 02:57:23,634 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f24d5c7364dc46a997a2341e39dfc76e 2023-02-08 02:57:23,635 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9b6734a6d08c30735bfd45bd3735f0e9/family1 of 9b6734a6d08c30735bfd45bd3735f0e9 into f24d5c7364dc46a997a2341e39dfc76e(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:57:23,635 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegion(2288): Compaction status journal for 9b6734a6d08c30735bfd45bd3735f0e9: 2023-02-08 02:57:23,635 DEBUG [Listener at localhost.localdomain/44017] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 02:57:23,635 DEBUG [Listener at localhost.localdomain/44017] regionserver.HStore(1912): 9b6734a6d08c30735bfd45bd3735f0e9/family2 is initiating major compaction (all files) 2023-02-08 02:57:23,635 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 02:57:23,635 INFO [Listener at localhost.localdomain/44017] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 02:57:23,635 INFO [Listener at localhost.localdomain/44017] regionserver.HRegion(2258): Starting compaction of 9b6734a6d08c30735bfd45bd3735f0e9/family2 in testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:23,635 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/b1187445590d4db3a7dfe57576d45090, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/1261fadd0f6a42388a2307485b8ece65, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/a435d5cb4c88407f999a36ad8c766a28, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/73a5743093994defa790b7b6a5f2d19f, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/9cb5e775a97747a3ae94ede3ca56f04e] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp, totalSize=25.4 K 2023-02-08 02:57:23,636 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting b1187445590d4db3a7dfe57576d45090, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825023787 2023-02-08 02:57:23,637 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 1261fadd0f6a42388a2307485b8ece65, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825024966 2023-02-08 02:57:23,637 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting a435d5cb4c88407f999a36ad8c766a28, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825026843 2023-02-08 02:57:23,638 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 73a5743093994defa790b7b6a5f2d19f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825028832 2023-02-08 02:57:23,638 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 9cb5e775a97747a3ae94ede3ca56f04e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-08 02:57:23,652 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareThroughputController(145): 9b6734a6d08c30735bfd45bd3735f0e9#family2#compaction#113 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:57:23,713 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/572417a992924edd9957eb1d317e11cd, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/74ebb73f89444c198ac38e137c8ae954, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/dcd3aca6561e4731a8a12ee6f7fc1a94, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/eb2c7dbb4f14414f8338b35f68b559fa, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/5b4b34ae719f4bc68f54aef1e39cfb6e] to archive 2023-02-08 02:57:23,715 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:23,720 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/572417a992924edd9957eb1d317e11cd to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/572417a992924edd9957eb1d317e11cd 2023-02-08 02:57:23,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/74ebb73f89444c198ac38e137c8ae954 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/74ebb73f89444c198ac38e137c8ae954 2023-02-08 02:57:23,726 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/dcd3aca6561e4731a8a12ee6f7fc1a94 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/dcd3aca6561e4731a8a12ee6f7fc1a94 2023-02-08 02:57:23,728 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/eb2c7dbb4f14414f8338b35f68b559fa to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/eb2c7dbb4f14414f8338b35f68b559fa 2023-02-08 02:57:23,731 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/5b4b34ae719f4bc68f54aef1e39cfb6e to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/5b4b34ae719f4bc68f54aef1e39cfb6e 2023-02-08 02:57:24,071 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230208378c84172c5d414ea34725e9ce6c51db_del 2023-02-08 02:57:24,071 INFO [Listener at localhost.localdomain/44017] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208378c84172c5d414ea34725e9ce6c51db_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208378c84172c5d414ea34725e9ce6c51db_del 2023-02-08 02:57:24,899 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 803799788a5f4955a48908229d93628c 2023-02-08 02:57:24,902 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family2/803799788a5f4955a48908229d93628c as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/803799788a5f4955a48908229d93628c 2023-02-08 02:57:24,909 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 803799788a5f4955a48908229d93628c 2023-02-08 02:57:24,911 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9b6734a6d08c30735bfd45bd3735f0e9/family2 of 9b6734a6d08c30735bfd45bd3735f0e9 into 803799788a5f4955a48908229d93628c(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:57:24,911 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegion(2288): Compaction status journal for 9b6734a6d08c30735bfd45bd3735f0e9: 2023-02-08 02:57:24,914 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/b1187445590d4db3a7dfe57576d45090, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/1261fadd0f6a42388a2307485b8ece65, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/a435d5cb4c88407f999a36ad8c766a28, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/73a5743093994defa790b7b6a5f2d19f, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/9cb5e775a97747a3ae94ede3ca56f04e] to archive 2023-02-08 02:57:24,915 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:24,918 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/b1187445590d4db3a7dfe57576d45090 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/b1187445590d4db3a7dfe57576d45090 2023-02-08 02:57:24,920 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 02:57:24,920 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/1261fadd0f6a42388a2307485b8ece65 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/1261fadd0f6a42388a2307485b8ece65 2023-02-08 02:57:24,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/a435d5cb4c88407f999a36ad8c766a28 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/a435d5cb4c88407f999a36ad8c766a28 2023-02-08 02:57:24,926 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/73a5743093994defa790b7b6a5f2d19f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/73a5743093994defa790b7b6a5f2d19f 2023-02-08 02:57:24,927 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 02:57:24,927 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/9cb5e775a97747a3ae94ede3ca56f04e to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/9cb5e775a97747a3ae94ede3ca56f04e 2023-02-08 02:57:24,932 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 02:57:24,933 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 02:57:24,940 INFO [Listener at localhost.localdomain/44017] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-08 02:57:24,975 INFO [Listener at localhost.localdomain/44017] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-08 02:57:24,979 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230208acc55e7484d643dcb31660fdc7b76ed4_del 2023-02-08 02:57:24,983 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230208e80f01536b534dcebe25f28e4f04e032_del 2023-02-08 02:57:24,987 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230208c33ecbf5e63f4d36bbc07a80664932d6_del 2023-02-08 02:57:24,987 INFO [Listener at localhost.localdomain/44017] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-08 02:57:24,988 DEBUG [Listener at localhost.localdomain/44017] zookeeper.ReadOnlyZKClient(139): Connect 0x21466a4c to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:57:25,054 DEBUG [Listener at localhost.localdomain/44017] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7884daa8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:57:25,055 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 02:57:25,055 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 02:57:25,055 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 02:57:25,114 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302085b0674c2e32740049f657e35bcbb44c7 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302085b0674c2e32740049f657e35bcbb44c7 2023-02-08 02:57:25,114 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 02:57:25,125 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 02:57:25,129 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:39744, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 02:57:25,135 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:25,135 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:25,135 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 02:57:25,138 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:60748, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 02:57:25,147 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230208/family1/79d104ce599049a9a22a856abf782133 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-08 02:57:25,147 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230208/family1/79d104ce599049a9a22a856abf782133}] 2023-02-08 02:57:25,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230208/family1/79d104ce599049a9a22a856abf782133 for inclusion in 12373e98d6fb3636c0d02a5815aad09c/family1 2023-02-08 02:57:25,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-08 02:57:25,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-08 02:57:25,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for 12373e98d6fb3636c0d02a5815aad09c: 2023-02-08 02:57:25,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230208/family1/79d104ce599049a9a22a856abf782133 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__2rdtlus14nu4o1b7ofpf3em15kk3qlheh7uv42d1godegh8m55d2t2i2pn425vvn/family1/79d104ce599049a9a22a856abf782133 2023-02-08 02:57:25,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__2rdtlus14nu4o1b7ofpf3em15kk3qlheh7uv42d1godegh8m55d2t2i2pn425vvn/family1/79d104ce599049a9a22a856abf782133 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/7b6de72f1bce4f09907339e8b488cf00_SeqId_29_ 2023-02-08 02:57:25,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__2rdtlus14nu4o1b7ofpf3em15kk3qlheh7uv42d1godegh8m55d2t2i2pn425vvn/family1/79d104ce599049a9a22a856abf782133 into 12373e98d6fb3636c0d02a5815aad09c/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/7b6de72f1bce4f09907339e8b488cf00_SeqId_29_ - updating store file list. 2023-02-08 02:57:25,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/7b6de72f1bce4f09907339e8b488cf00_SeqId_29_ into 12373e98d6fb3636c0d02a5815aad09c/family1 2023-02-08 02:57:25,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__2rdtlus14nu4o1b7ofpf3em15kk3qlheh7uv42d1godegh8m55d2t2i2pn425vvn/family1/79d104ce599049a9a22a856abf782133 into 12373e98d6fb3636c0d02a5815aad09c/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/7b6de72f1bce4f09907339e8b488cf00_SeqId_29_) 2023-02-08 02:57:25,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__2rdtlus14nu4o1b7ofpf3em15kk3qlheh7uv42d1godegh8m55d2t2i2pn425vvn/family1/79d104ce599049a9a22a856abf782133 2023-02-08 02:57:25,164 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 02:57:25,165 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:25,166 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302082abfaffeee9d47f4b7a06bf1946c7473 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302082abfaffeee9d47f4b7a06bf1946c7473 2023-02-08 02:57:25,167 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302083b0c47ca4c3c415595ff61688d27604f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302083b0c47ca4c3c415595ff61688d27604f 2023-02-08 02:57:25,168 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020864f2f309fbcf47d3ba43dfd77a0618eb to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020864f2f309fbcf47d3ba43dfd77a0618eb 2023-02-08 02:57:25,169 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208fb0cde7d75254f838f6d87d16d755d49 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208fb0cde7d75254f838f6d87d16d755d49 2023-02-08 02:57:25,170 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-08 02:57:25,170 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230208' 2023-02-08 02:57:25,170 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 02:57:25,927 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208bf297690050f48a583b74a5d87d31360 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208bf297690050f48a583b74a5d87d31360 2023-02-08 02:57:25,927 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020899c6148e3a564345951928360bf3a4cd to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020899c6148e3a564345951928360bf3a4cd 2023-02-08 02:57:25,928 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 02:57:25,928 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 02:57:25,944 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:25,944 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:25,944 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:25,944 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:25,952 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230208/family1/2f6c0480c3bf447390452a7b206ab58f first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-08 02:57:25,952 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230208/family1/a2d4cfe2bd9743c0b24ce60833aa9dec first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-08 02:57:25,953 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230208/family1/2f6c0480c3bf447390452a7b206ab58f}] 2023-02-08 02:57:25,953 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230208/family1/a2d4cfe2bd9743c0b24ce60833aa9dec}] 2023-02-08 02:57:25,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230208/family1/2f6c0480c3bf447390452a7b206ab58f for inclusion in 9b6734a6d08c30735bfd45bd3735f0e9/family1 2023-02-08 02:57:25,956 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230208/family1/a2d4cfe2bd9743c0b24ce60833aa9dec for inclusion in 903c5e7f299e5714b7640c3c91b635f1/family1 2023-02-08 02:57:25,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-08 02:57:25,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-08 02:57:25,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last=1 2023-02-08 02:57:25,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-08 02:57:25,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for 9b6734a6d08c30735bfd45bd3735f0e9: 2023-02-08 02:57:25,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for 903c5e7f299e5714b7640c3c91b635f1: 2023-02-08 02:57:25,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230208/family1/a2d4cfe2bd9743c0b24ce60833aa9dec to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__64e9333go9fuihtbv1p5el00u6n42f5t8u2sm98pteon7n1fiajtf10tk44du64h/family1/a2d4cfe2bd9743c0b24ce60833aa9dec 2023-02-08 02:57:25,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230208/family1/2f6c0480c3bf447390452a7b206ab58f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__ds4ga3at0id1sr9pmiciiii4ajt1lvipplmng6vo848ee7hugcpdbs9jb4v7vfei/family1/2f6c0480c3bf447390452a7b206ab58f 2023-02-08 02:57:25,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__64e9333go9fuihtbv1p5el00u6n42f5t8u2sm98pteon7n1fiajtf10tk44du64h/family1/a2d4cfe2bd9743c0b24ce60833aa9dec as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/5e8d7aa7b86d453d9704cfc645595c1f_SeqId_29_ 2023-02-08 02:57:25,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__ds4ga3at0id1sr9pmiciiii4ajt1lvipplmng6vo848ee7hugcpdbs9jb4v7vfei/family1/2f6c0480c3bf447390452a7b206ab58f as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/b51ae189eea74365a4d814f428ddf3fb_SeqId_29_ 2023-02-08 02:57:25,963 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__64e9333go9fuihtbv1p5el00u6n42f5t8u2sm98pteon7n1fiajtf10tk44du64h/family1/a2d4cfe2bd9743c0b24ce60833aa9dec into 903c5e7f299e5714b7640c3c91b635f1/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/5e8d7aa7b86d453d9704cfc645595c1f_SeqId_29_ - updating store file list. 2023-02-08 02:57:25,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__ds4ga3at0id1sr9pmiciiii4ajt1lvipplmng6vo848ee7hugcpdbs9jb4v7vfei/family1/2f6c0480c3bf447390452a7b206ab58f into 9b6734a6d08c30735bfd45bd3735f0e9/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/b51ae189eea74365a4d814f428ddf3fb_SeqId_29_ - updating store file list. 2023-02-08 02:57:25,967 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/5e8d7aa7b86d453d9704cfc645595c1f_SeqId_29_ into 903c5e7f299e5714b7640c3c91b635f1/family1 2023-02-08 02:57:25,967 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__64e9333go9fuihtbv1p5el00u6n42f5t8u2sm98pteon7n1fiajtf10tk44du64h/family1/a2d4cfe2bd9743c0b24ce60833aa9dec into 903c5e7f299e5714b7640c3c91b635f1/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/5e8d7aa7b86d453d9704cfc645595c1f_SeqId_29_) 2023-02-08 02:57:25,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/b51ae189eea74365a4d814f428ddf3fb_SeqId_29_ into 9b6734a6d08c30735bfd45bd3735f0e9/family1 2023-02-08 02:57:25,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__ds4ga3at0id1sr9pmiciiii4ajt1lvipplmng6vo848ee7hugcpdbs9jb4v7vfei/family1/2f6c0480c3bf447390452a7b206ab58f into 9b6734a6d08c30735bfd45bd3735f0e9/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/b51ae189eea74365a4d814f428ddf3fb_SeqId_29_) 2023-02-08 02:57:25,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__64e9333go9fuihtbv1p5el00u6n42f5t8u2sm98pteon7n1fiajtf10tk44du64h/family1/a2d4cfe2bd9743c0b24ce60833aa9dec 2023-02-08 02:57:25,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__ds4ga3at0id1sr9pmiciiii4ajt1lvipplmng6vo848ee7hugcpdbs9jb4v7vfei/family1/2f6c0480c3bf447390452a7b206ab58f 2023-02-08 02:57:25,969 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 02:57:25,969 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 02:57:25,970 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:25,970 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:25,972 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020850a5b5a2593a4e958246e5e0bec02dd5 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020850a5b5a2593a4e958246e5e0bec02dd5 2023-02-08 02:57:25,972 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302085df9d34cb6554b4fa10790c14470f5e4 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302085df9d34cb6554b4fa10790c14470f5e4 2023-02-08 02:57:25,973 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208a194b2886199442282b4ff0e357620d1 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208a194b2886199442282b4ff0e357620d1 2023-02-08 02:57:25,973 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302086d9a7bcab1264e5a94d350c136fe2526 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302086d9a7bcab1264e5a94d350c136fe2526 2023-02-08 02:57:25,974 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208a9cce4b809f844d5a20945726625d298 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208a9cce4b809f844d5a20945726625d298 2023-02-08 02:57:25,974 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208efbe5934e4f048bebf5ddcd5da7d15f0 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208efbe5934e4f048bebf5ddcd5da7d15f0 2023-02-08 02:57:25,975 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208c1546cb71c164793acead2f5a9ecc4b9 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208c1546cb71c164793acead2f5a9ecc4b9 2023-02-08 02:57:25,975 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-08 02:57:25,975 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208f249b02e92304f509f6beea9cb102a37 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208f249b02e92304f509f6beea9cb102a37 2023-02-08 02:57:25,975 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230208' 2023-02-08 02:57:25,975 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-08 02:57:25,976 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230208' 2023-02-08 02:57:25,976 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 02:57:25,976 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 02:57:25,976 INFO [Listener at localhost.localdomain/44017] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-08 02:57:25,976 INFO [Listener at localhost.localdomain/44017] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 02:57:25,976 INFO [Listener at localhost.localdomain/44017] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208acc55e7484d643dcb31660fdc7b76ed4_del] 2023-02-08 02:57:25,977 DEBUG [Listener at localhost.localdomain/44017] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:25,979 DEBUG [Listener at localhost.localdomain/44017] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208acc55e7484d643dcb31660fdc7b76ed4_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208acc55e7484d643dcb31660fdc7b76ed4_del 2023-02-08 02:57:25,979 INFO [Listener at localhost.localdomain/44017] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-08 02:57:25,979 INFO [Listener at localhost.localdomain/44017] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208e80f01536b534dcebe25f28e4f04e032_del] 2023-02-08 02:57:25,979 DEBUG [Listener at localhost.localdomain/44017] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:25,982 DEBUG [Listener at localhost.localdomain/44017] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208e80f01536b534dcebe25f28e4f04e032_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208e80f01536b534dcebe25f28e4f04e032_del 2023-02-08 02:57:25,982 INFO [Listener at localhost.localdomain/44017] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-08 02:57:25,983 INFO [Listener at localhost.localdomain/44017] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208c33ecbf5e63f4d36bbc07a80664932d6_del] 2023-02-08 02:57:25,983 DEBUG [Listener at localhost.localdomain/44017] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:25,985 DEBUG [Listener at localhost.localdomain/44017] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208c33ecbf5e63f4d36bbc07a80664932d6_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208c33ecbf5e63f4d36bbc07a80664932d6_del 2023-02-08 02:57:25,985 INFO [Listener at localhost.localdomain/44017] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-08 02:57:25,989 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 02:57:25,992 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 02:57:25,996 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 02:57:25,998 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 02:57:26,006 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:26,007 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:26,007 INFO [Listener at localhost.localdomain/44017] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-02-08 02:57:26,008 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.HMaster$11(2405): Client=jenkins//136.243.104.168 disable testCompactionWithHFileLink 2023-02-08 02:57:26,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-02-08 02:57:26,010 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:26,010 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:26,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-08 02:57:26,011 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675825046011"}]},"ts":"1675825046011"} 2023-02-08 02:57:26,012 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-02-08 02:57:26,063 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-02-08 02:57:26,064 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9b6734a6d08c30735bfd45bd3735f0e9, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=12373e98d6fb3636c0d02a5815aad09c, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=903c5e7f299e5714b7640c3c91b635f1, UNASSIGN}] 2023-02-08 02:57:26,065 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=903c5e7f299e5714b7640c3c91b635f1, UNASSIGN 2023-02-08 02:57:26,066 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9b6734a6d08c30735bfd45bd3735f0e9, UNASSIGN 2023-02-08 02:57:26,066 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=12373e98d6fb3636c0d02a5815aad09c, UNASSIGN 2023-02-08 02:57:26,067 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=903c5e7f299e5714b7640c3c91b635f1, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:26,067 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=9b6734a6d08c30735bfd45bd3735f0e9, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:26,067 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=12373e98d6fb3636c0d02a5815aad09c, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:26,067 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675825046067"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675825046067"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675825046067"}]},"ts":"1675825046067"} 2023-02-08 02:57:26,067 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675825046067"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675825046067"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675825046067"}]},"ts":"1675825046067"} 2023-02-08 02:57:26,067 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675825046067"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675825046067"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675825046067"}]},"ts":"1675825046067"} 2023-02-08 02:57:26,069 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=89, state=RUNNABLE; CloseRegionProcedure 9b6734a6d08c30735bfd45bd3735f0e9, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:57:26,070 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; CloseRegionProcedure 903c5e7f299e5714b7640c3c91b635f1, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:57:26,071 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=90, state=RUNNABLE; CloseRegionProcedure 12373e98d6fb3636c0d02a5815aad09c, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:57:26,111 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:26,111 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:26,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-08 02:57:26,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close 903c5e7f299e5714b7640c3c91b635f1 2023-02-08 02:57:26,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 903c5e7f299e5714b7640c3c91b635f1, disabling compactions & flushes 2023-02-08 02:57:26,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:26,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:26,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. after waiting 0 ms 2023-02-08 02:57:26,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:26,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-08 02:57:26,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:26,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 903c5e7f299e5714b7640c3c91b635f1: Waiting for close lock at 1675825046222Running coprocessor pre-close hooks at 1675825046222Disabling compacts and flushes for region at 1675825046222Disabling writes for close at 1675825046223 (+1 ms)Writing region close event to WAL at 1675825046227 (+4 ms)Running coprocessor post-close hooks at 1675825046236 (+9 ms)Closed at 1675825046237 (+1 ms) 2023-02-08 02:57:26,239 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed 903c5e7f299e5714b7640c3c91b635f1 2023-02-08 02:57:26,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close 12373e98d6fb3636c0d02a5815aad09c 2023-02-08 02:57:26,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 12373e98d6fb3636c0d02a5815aad09c, disabling compactions & flushes 2023-02-08 02:57:26,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:26,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:26,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. after waiting 0 ms 2023-02-08 02:57:26,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:26,240 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=903c5e7f299e5714b7640c3c91b635f1, regionState=CLOSED 2023-02-08 02:57:26,240 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675825046240"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675825046240"}]},"ts":"1675825046240"} 2023-02-08 02:57:26,246 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-02-08 02:57:26,246 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; CloseRegionProcedure 903c5e7f299e5714b7640c3c91b635f1, server=jenkins-hbase12.apache.org,44577,1675824910652 in 174 msec 2023-02-08 02:57:26,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-08 02:57:26,247 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=903c5e7f299e5714b7640c3c91b635f1, UNASSIGN in 182 msec 2023-02-08 02:57:26,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:26,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 12373e98d6fb3636c0d02a5815aad09c: Waiting for close lock at 1675825046240Running coprocessor pre-close hooks at 1675825046240Disabling compacts and flushes for region at 1675825046240Disabling writes for close at 1675825046240Writing region close event to WAL at 1675825046244 (+4 ms)Running coprocessor post-close hooks at 1675825046248 (+4 ms)Closed at 1675825046248 2023-02-08 02:57:26,249 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed 12373e98d6fb3636c0d02a5815aad09c 2023-02-08 02:57:26,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close 9b6734a6d08c30735bfd45bd3735f0e9 2023-02-08 02:57:26,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 9b6734a6d08c30735bfd45bd3735f0e9, disabling compactions & flushes 2023-02-08 02:57:26,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:26,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:26,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. after waiting 0 ms 2023-02-08 02:57:26,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:26,250 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=12373e98d6fb3636c0d02a5815aad09c, regionState=CLOSED 2023-02-08 02:57:26,250 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675825046250"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675825046250"}]},"ts":"1675825046250"} 2023-02-08 02:57:26,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=90 2023-02-08 02:57:26,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=90, state=SUCCESS; CloseRegionProcedure 12373e98d6fb3636c0d02a5815aad09c, server=jenkins-hbase12.apache.org,44577,1675824910652 in 183 msec 2023-02-08 02:57:26,256 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=12373e98d6fb3636c0d02a5815aad09c, UNASSIGN in 191 msec 2023-02-08 02:57:26,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-08 02:57:26,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:26,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 9b6734a6d08c30735bfd45bd3735f0e9: Waiting for close lock at 1675825046250Running coprocessor pre-close hooks at 1675825046250Disabling compacts and flushes for region at 1675825046250Disabling writes for close at 1675825046250Writing region close event to WAL at 1675825046254 (+4 ms)Running coprocessor post-close hooks at 1675825046257 (+3 ms)Closed at 1675825046257 2023-02-08 02:57:26,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed 9b6734a6d08c30735bfd45bd3735f0e9 2023-02-08 02:57:26,259 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=9b6734a6d08c30735bfd45bd3735f0e9, regionState=CLOSED 2023-02-08 02:57:26,259 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675825046259"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675825046259"}]},"ts":"1675825046259"} 2023-02-08 02:57:26,262 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=89 2023-02-08 02:57:26,262 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=89, state=SUCCESS; CloseRegionProcedure 9b6734a6d08c30735bfd45bd3735f0e9, server=jenkins-hbase12.apache.org,44577,1675824910652 in 192 msec 2023-02-08 02:57:26,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=89, resume processing ppid=88 2023-02-08 02:57:26,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9b6734a6d08c30735bfd45bd3735f0e9, UNASSIGN in 198 msec 2023-02-08 02:57:26,265 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675825046264"}]},"ts":"1675825046264"} 2023-02-08 02:57:26,266 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-02-08 02:57:26,273 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-02-08 02:57:26,275 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 266 msec 2023-02-08 02:57:26,312 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:26,313 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:26,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-08 02:57:26,314 INFO [Listener at localhost.localdomain/44017] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-02-08 02:57:26,315 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:26,315 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:26,330 INFO [Listener at localhost.localdomain/44017] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1675825030808-1675825046330 2023-02-08 02:57:26,330 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:26,330 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:26,331 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1580): Client=jenkins//136.243.104.168 snapshot request for:{ ss=hbase-failsafe-snaptb-1675825030808-1675825046330 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-08 02:57:26,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675825046331 (current time:1675825046331). 2023-02-08 02:57:26,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-08 02:57:26,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] zookeeper.ReadOnlyZKClient(139): Connect 0x026288c7 to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:57:26,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3783cd00, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:57:26,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 02:57:26,352 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:39754, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 02:57:26,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x026288c7 to 127.0.0.1:49602 2023-02-08 02:57:26,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:57:26,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-08 02:57:26,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1675825030808-1675825046330 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-08 02:57:26,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-08 02:57:26,358 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-08 02:57:26,360 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1675825646360 2023-02-08 02:57:26,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1675825030808-1675825046330 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-08 02:57:26,360 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1675825030808-1675825046330 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-08 02:57:26,361 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1675825030808-1675825046330 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-08 02:57:26,361 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-08 02:57:26,461 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 02:57:26,461 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:26,462 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:26,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675825030808-1675825046330 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 02:57:26,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675825030808-1675825046330 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-08 02:57:26,465 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-08 02:57:26,665 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 02:57:26,665 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:26,666 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:26,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675825030808-1675825046330 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 02:57:26,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675825030808-1675825046330 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-08 02:57:26,669 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-08 02:57:26,771 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1675825030808-1675825046330 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-02-08 02:57:26,775 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-08 02:57:26,775 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-08 02:57:26,775 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-08 02:57:26,775 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-08 02:57:26,775 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-08 02:57:26,776 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-08 02:57:26,776 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-08 02:57:26,776 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-08 02:57:26,779 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/b51ae189eea74365a4d814f428ddf3fb_SeqId_29_, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/f24d5c7364dc46a997a2341e39dfc76e] hfiles 2023-02-08 02:57:26,779 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/b51ae189eea74365a4d814f428ddf3fb_SeqId_29_ 2023-02-08 02:57:26,779 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/5e8d7aa7b86d453d9704cfc645595c1f_SeqId_29_, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/d9c5de2f7c204dca838b47d05d64ca04] hfiles 2023-02-08 02:57:26,779 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/f24d5c7364dc46a997a2341e39dfc76e 2023-02-08 02:57:26,779 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/5e8d7aa7b86d453d9704cfc645595c1f_SeqId_29_ 2023-02-08 02:57:26,779 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/d9c5de2f7c204dca838b47d05d64ca04 2023-02-08 02:57:26,779 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302085b0674c2e32740049f657e35bcbb44c7, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020899c6148e3a564345951928360bf3a4cd, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208bf297690050f48a583b74a5d87d31360] hfiles 2023-02-08 02:57:26,779 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302085b0674c2e32740049f657e35bcbb44c7 2023-02-08 02:57:26,779 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/7b6de72f1bce4f09907339e8b488cf00_SeqId_29_, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/e53ce900860743c8a4e36c57cd16f5dc] hfiles 2023-02-08 02:57:26,779 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020899c6148e3a564345951928360bf3a4cd 2023-02-08 02:57:26,780 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/7b6de72f1bce4f09907339e8b488cf00_SeqId_29_ 2023-02-08 02:57:26,780 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208bf297690050f48a583b74a5d87d31360 2023-02-08 02:57:26,780 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/e53ce900860743c8a4e36c57cd16f5dc 2023-02-08 02:57:26,780 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/803799788a5f4955a48908229d93628c] hfiles 2023-02-08 02:57:26,780 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/803799788a5f4955a48908229d93628c 2023-02-08 02:57:26,780 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/17f02504914f45a1ae4c141e36370a71] hfiles 2023-02-08 02:57:26,780 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/17f02504914f45a1ae4c141e36370a71 2023-02-08 02:57:26,781 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/ff84f49b79e348fa9f2b6bf794a9707b] hfiles 2023-02-08 02:57:26,781 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/ff84f49b79e348fa9f2b6bf794a9707b 2023-02-08 02:57:26,792 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020814e6c41b1a35418a893d40e802e57095, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302084767b68987664c498537a00abb6f4de6_del, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020856b9d137eb24440a8cef7dac03a6da0e, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230208a336d25cc0f74c0f993b7c0ed944f3db, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230208ec999d99a4b542138d8a1f3e2297d7ff, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302080d4db9d9f74d447582bfe1a266d0607c_del, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020841795392be9341ceaa3c3845aaa7604b, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302084386c3016e5e414d8af89d8abc052249, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208534527c541b94e9495b68744da745a62, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208fa2e306be45d437eb8d6c07df5a7a538, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023020818548b0f8a26462487e62c5efc3248bd, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208378c84172c5d414ea34725e9ce6c51db_del, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023020893649b1a3d1d4eb08c996b04a45f2b83, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208b58f009ea8ba44779faffd18f30ab17e, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208c789ab5a3e5f4e2aa9c010c3afad88ac] hfiles 2023-02-08 02:57:26,792 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020814e6c41b1a35418a893d40e802e57095 2023-02-08 02:57:26,792 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302084767b68987664c498537a00abb6f4de6_del 2023-02-08 02:57:26,792 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020856b9d137eb24440a8cef7dac03a6da0e 2023-02-08 02:57:26,793 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230208a336d25cc0f74c0f993b7c0ed944f3db 2023-02-08 02:57:26,793 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230208ec999d99a4b542138d8a1f3e2297d7ff 2023-02-08 02:57:26,793 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302080d4db9d9f74d447582bfe1a266d0607c_del 2023-02-08 02:57:26,793 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020841795392be9341ceaa3c3845aaa7604b 2023-02-08 02:57:26,793 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302084386c3016e5e414d8af89d8abc052249 2023-02-08 02:57:26,793 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208534527c541b94e9495b68744da745a62 2023-02-08 02:57:26,793 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208fa2e306be45d437eb8d6c07df5a7a538 2023-02-08 02:57:26,793 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023020818548b0f8a26462487e62c5efc3248bd 2023-02-08 02:57:26,793 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208378c84172c5d414ea34725e9ce6c51db_del 2023-02-08 02:57:26,793 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023020893649b1a3d1d4eb08c996b04a45f2b83 2023-02-08 02:57:26,793 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208b58f009ea8ba44779faffd18f30ab17e 2023-02-08 02:57:26,793 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208c789ab5a3e5f4e2aa9c010c3afad88ac 2023-02-08 02:57:26,970 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 02:57:26,970 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:26,970 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:26,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675825030808-1675825046330 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 02:57:26,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675825030808-1675825046330 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-08 02:57:26,973 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-08 02:57:27,200 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1675825030808-1675825046330 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-02-08 02:57:27,200 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1675825030808-1675825046330 2023-02-08 02:57:27,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675825030808-1675825046330 2023-02-08 02:57:27,473 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 02:57:27,473 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:27,474 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:27,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675825030808-1675825046330 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 02:57:27,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675825030808-1675825046330 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-08 02:57:27,477 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-08 02:57:27,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675825030808-1675825046330 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.hbase-snapshot/hbase-failsafe-snaptb-1675825030808-1675825046330 2023-02-08 02:57:28,477 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 02:57:28,477 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:28,477 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:28,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675825030808-1675825046330 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 02:57:28,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675825030808-1675825046330 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-08 02:57:28,480 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-02-08 02:57:28,497 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1675825030808-1675825046330 of table testCompactionWithHFileLink completed 2023-02-08 02:57:28,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675825030808-1675825046330 2023-02-08 02:57:28,498 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675825030808-1675825046330 2023-02-08 02:57:28,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1675825030808-1675825046330 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1675825046360Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1675825030808-1675825046330 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1675825046772 (+412 ms)Consolidate snapshot: hbase-failsafe-snaptb-1675825030808-1675825046330 at 1675825047200 (+428 ms)Loading Region manifests for hbase-failsafe-snaptb-1675825030808-1675825046330 at 1675825047200Writing data manifest for hbase-failsafe-snaptb-1675825030808-1675825046330 at 1675825047206 (+6 ms)Verifying snapshot: hbase-failsafe-snaptb-1675825030808-1675825046330 at 1675825047656 (+450 ms)Snapshot hbase-failsafe-snaptb-1675825030808-1675825046330 of table testCompactionWithHFileLink completed at 1675825048497 (+841 ms) 2023-02-08 02:57:28,501 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-08 02:57:28,505 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 2.1450 sec 2023-02-08 02:57:30,480 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 02:57:30,481 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:30,481 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:30,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675825030808-1675825046330 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 02:57:30,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1675825030808-1675825046330 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-08 02:57:30,486 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:30,486 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:30,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1675825030808" table: "testCompactionWithHFileLink" creation_time: 1675825030820 type: FLUSH version: 2 ttl: 0 ) 2023-02-08 02:57:30,524 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1675825030808 as table=testCompactionWithHFileLink 2023-02-08 02:57:30,526 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:30,526 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:30,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-08 02:57:30,627 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:30,628 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:30,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-08 02:57:30,830 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:30,830 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:30,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-08 02:57:30,933 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-08 02:57:30,934 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-08 02:57:30,934 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-08 02:57:30,934 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1675825030808 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-08 02:57:30,938 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1675825030808" table: "testCompactionWithHFileLink" creation_time: 1675825030820 type: FLUSH version: 2 ttl: 0 2023-02-08 02:57:30,939 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink 2023-02-08 02:57:30,945 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-02-08 02:57:30,948 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208bf297690050f48a583b74a5d87d31360 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208bf297690050f48a583b74a5d87d31360 2023-02-08 02:57:30,950 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302085b0674c2e32740049f657e35bcbb44c7 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302085b0674c2e32740049f657e35bcbb44c7 2023-02-08 02:57:30,951 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020899c6148e3a564345951928360bf3a4cd to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020899c6148e3a564345951928360bf3a4cd 2023-02-08 02:57:30,951 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202302082abfaffeee9d47f4b7a06bf1946c7473 of snapshot=snaptb-1675825030808 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 02:57:30,954 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202302083b0c47ca4c3c415595ff61688d27604f of snapshot=snaptb-1675825030808 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 02:57:30,958 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023020864f2f309fbcf47d3ba43dfd77a0618eb of snapshot=snaptb-1675825030808 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 02:57:30,962 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230208fb0cde7d75254f838f6d87d16d755d49 of snapshot=snaptb-1675825030808 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 02:57:30,965 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023020850a5b5a2593a4e958246e5e0bec02dd5 of snapshot=snaptb-1675825030808 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 02:57:30,968 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230208a194b2886199442282b4ff0e357620d1 of snapshot=snaptb-1675825030808 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 02:57:30,971 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230208a9cce4b809f844d5a20945726625d298 of snapshot=snaptb-1675825030808 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 02:57:30,974 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230208c1546cb71c164793acead2f5a9ecc4b9 of snapshot=snaptb-1675825030808 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 02:57:30,977 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202302085df9d34cb6554b4fa10790c14470f5e4 of snapshot=snaptb-1675825030808 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 02:57:30,980 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202302086d9a7bcab1264e5a94d350c136fe2526 of snapshot=snaptb-1675825030808 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 02:57:30,983 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230208efbe5934e4f048bebf5ddcd5da7d15f0 of snapshot=snaptb-1675825030808 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 02:57:30,985 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230208f249b02e92304f509f6beea9cb102a37 of snapshot=snaptb-1675825030808 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 02:57:30,991 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302084767b68987664c498537a00abb6f4de6_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302084767b68987664c498537a00abb6f4de6_del 2023-02-08 02:57:30,992 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208378c84172c5d414ea34725e9ce6c51db_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208378c84172c5d414ea34725e9ce6c51db_del 2023-02-08 02:57:30,993 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302080d4db9d9f74d447582bfe1a266d0607c_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302080d4db9d9f74d447582bfe1a266d0607c_del 2023-02-08 02:57:30,993 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: 12373e98d6fb3636c0d02a5815aad09c 2023-02-08 02:57:30,993 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: 903c5e7f299e5714b7640c3c91b635f1 2023-02-08 02:57:30,993 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: 9b6734a6d08c30735bfd45bd3735f0e9 2023-02-08 02:57:30,996 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/d9c5de2f7c204dca838b47d05d64ca04 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/d9c5de2f7c204dca838b47d05d64ca04 2023-02-08 02:57:30,996 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/b51ae189eea74365a4d814f428ddf3fb_SeqId_29_ to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/b51ae189eea74365a4d814f428ddf3fb_SeqId_29_ 2023-02-08 02:57:30,996 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/e53ce900860743c8a4e36c57cd16f5dc to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/e53ce900860743c8a4e36c57cd16f5dc 2023-02-08 02:57:30,997 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/f24d5c7364dc46a997a2341e39dfc76e to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/f24d5c7364dc46a997a2341e39dfc76e 2023-02-08 02:57:30,997 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 572417a992924edd9957eb1d317e11cd of snapshot=snaptb-1675825030808 to region=9b6734a6d08c30735bfd45bd3735f0e9 table=testCompactionWithHFileLink 2023-02-08 02:57:30,997 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/5e8d7aa7b86d453d9704cfc645595c1f_SeqId_29_ to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/5e8d7aa7b86d453d9704cfc645595c1f_SeqId_29_ 2023-02-08 02:57:30,997 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/7b6de72f1bce4f09907339e8b488cf00_SeqId_29_ to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/7b6de72f1bce4f09907339e8b488cf00_SeqId_29_ 2023-02-08 02:57:30,997 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 50f7399a4dcf439196b9fe8cd2fc65e7 of snapshot=snaptb-1675825030808 to region=903c5e7f299e5714b7640c3c91b635f1 table=testCompactionWithHFileLink 2023-02-08 02:57:30,997 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 05d45fa5b0704cd699922167246d4cd0 of snapshot=snaptb-1675825030808 to region=12373e98d6fb3636c0d02a5815aad09c table=testCompactionWithHFileLink 2023-02-08 02:57:31,001 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 74ebb73f89444c198ac38e137c8ae954 of snapshot=snaptb-1675825030808 to region=9b6734a6d08c30735bfd45bd3735f0e9 table=testCompactionWithHFileLink 2023-02-08 02:57:31,004 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f1caa80c1620447d8d23991baa2c637d of snapshot=snaptb-1675825030808 to region=903c5e7f299e5714b7640c3c91b635f1 table=testCompactionWithHFileLink 2023-02-08 02:57:31,005 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4408b3d2330549328be2f2cd48bba925 of snapshot=snaptb-1675825030808 to region=12373e98d6fb3636c0d02a5815aad09c table=testCompactionWithHFileLink 2023-02-08 02:57:31,006 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink dcd3aca6561e4731a8a12ee6f7fc1a94 of snapshot=snaptb-1675825030808 to region=9b6734a6d08c30735bfd45bd3735f0e9 table=testCompactionWithHFileLink 2023-02-08 02:57:31,008 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3fe0ab37fbdd48999b8451a603110632 of snapshot=snaptb-1675825030808 to region=903c5e7f299e5714b7640c3c91b635f1 table=testCompactionWithHFileLink 2023-02-08 02:57:31,008 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bc906f7bf326433f8c5843320d441c07 of snapshot=snaptb-1675825030808 to region=12373e98d6fb3636c0d02a5815aad09c table=testCompactionWithHFileLink 2023-02-08 02:57:31,009 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink eb2c7dbb4f14414f8338b35f68b559fa of snapshot=snaptb-1675825030808 to region=9b6734a6d08c30735bfd45bd3735f0e9 table=testCompactionWithHFileLink 2023-02-08 02:57:31,010 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3c3fa3a23f91414183577cd2042f12eb of snapshot=snaptb-1675825030808 to region=12373e98d6fb3636c0d02a5815aad09c table=testCompactionWithHFileLink 2023-02-08 02:57:31,010 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0f553be334ff447186e0f65865546c5b of snapshot=snaptb-1675825030808 to region=903c5e7f299e5714b7640c3c91b635f1 table=testCompactionWithHFileLink 2023-02-08 02:57:31,013 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/803799788a5f4955a48908229d93628c to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/803799788a5f4955a48908229d93628c 2023-02-08 02:57:31,013 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b1187445590d4db3a7dfe57576d45090 of snapshot=snaptb-1675825030808 to region=9b6734a6d08c30735bfd45bd3735f0e9 table=testCompactionWithHFileLink 2023-02-08 02:57:31,015 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/ff84f49b79e348fa9f2b6bf794a9707b to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/ff84f49b79e348fa9f2b6bf794a9707b 2023-02-08 02:57:31,015 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 928cc4c90d034ecb865bc59f9c995a98 of snapshot=snaptb-1675825030808 to region=12373e98d6fb3636c0d02a5815aad09c table=testCompactionWithHFileLink 2023-02-08 02:57:31,015 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/17f02504914f45a1ae4c141e36370a71 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/17f02504914f45a1ae4c141e36370a71 2023-02-08 02:57:31,015 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bbd943ef42be4b8e9e1f390166f32a71 of snapshot=snaptb-1675825030808 to region=903c5e7f299e5714b7640c3c91b635f1 table=testCompactionWithHFileLink 2023-02-08 02:57:31,017 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1261fadd0f6a42388a2307485b8ece65 of snapshot=snaptb-1675825030808 to region=9b6734a6d08c30735bfd45bd3735f0e9 table=testCompactionWithHFileLink 2023-02-08 02:57:31,018 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 85cfdba51b0e4e10a82b14a5c1ae483b of snapshot=snaptb-1675825030808 to region=12373e98d6fb3636c0d02a5815aad09c table=testCompactionWithHFileLink 2023-02-08 02:57:31,018 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a9ce54357a1041f880875e4caf9dd161 of snapshot=snaptb-1675825030808 to region=903c5e7f299e5714b7640c3c91b635f1 table=testCompactionWithHFileLink 2023-02-08 02:57:31,021 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a435d5cb4c88407f999a36ad8c766a28 of snapshot=snaptb-1675825030808 to region=9b6734a6d08c30735bfd45bd3735f0e9 table=testCompactionWithHFileLink 2023-02-08 02:57:31,021 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2647224f0b9c40f4ae812131560548d9 of snapshot=snaptb-1675825030808 to region=12373e98d6fb3636c0d02a5815aad09c table=testCompactionWithHFileLink 2023-02-08 02:57:31,021 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e0d003e600d74b55b221352e281d07b9 of snapshot=snaptb-1675825030808 to region=903c5e7f299e5714b7640c3c91b635f1 table=testCompactionWithHFileLink 2023-02-08 02:57:31,024 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 73a5743093994defa790b7b6a5f2d19f of snapshot=snaptb-1675825030808 to region=9b6734a6d08c30735bfd45bd3735f0e9 table=testCompactionWithHFileLink 2023-02-08 02:57:31,024 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 29aa81036d3b45c7a1fc8d92d034bdbd of snapshot=snaptb-1675825030808 to region=12373e98d6fb3636c0d02a5815aad09c table=testCompactionWithHFileLink 2023-02-08 02:57:31,024 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ed556adc1747418f9d870d3e64080608 of snapshot=snaptb-1675825030808 to region=903c5e7f299e5714b7640c3c91b635f1 table=testCompactionWithHFileLink 2023-02-08 02:57:31,027 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1675825030808" table: "testCompactionWithHFileLink" creation_time: 1675825030820 type: FLUSH version: 2 ttl: 0 2023-02-08 02:57:31,028 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675825051028"}]},"ts":"9223372036854775807"} 2023-02-08 02:57:31,028 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675825051028"}]},"ts":"9223372036854775807"} 2023-02-08 02:57:31,028 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675825051028"}]},"ts":"9223372036854775807"} 2023-02-08 02:57:31,030 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-02-08 02:57:31,030 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 12373e98d6fb3636c0d02a5815aad09c, NAME => 'testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 903c5e7f299e5714b7640c3c91b635f1, NAME => 'testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 9b6734a6d08c30735bfd45bd3735f0e9, NAME => 'testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9.', STARTKEY => '', ENDKEY => '1'}] 2023-02-08 02:57:31,030 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675825051029"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675825051029"}]},"ts":"1675825051029"} 2023-02-08 02:57:31,030 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675825051029"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675825051029"}]},"ts":"1675825051029"} 2023-02-08 02:57:31,030 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675825051029"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675825051029"}]},"ts":"1675825051029"} 2023-02-08 02:57:31,032 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-08 02:57:31,032 INFO [PEWorker-5] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-02-08 02:57:31,032 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 12373e98d6fb3636c0d02a5815aad09c, NAME => 'testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 903c5e7f299e5714b7640c3c91b635f1, NAME => 'testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 9b6734a6d08c30735bfd45bd3735f0e9, NAME => 'testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9.', STARTKEY => '', ENDKEY => '1'}] 2023-02-08 02:57:31,033 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1675825030808 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-02-08 02:57:31,034 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1675825030808" table: "testCompactionWithHFileLink" creation_time: 1675825030820 type: FLUSH version: 2 ttl: 0 ) in 517 msec 2023-02-08 02:57:31,133 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:31,133 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:31,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-08 02:57:31,135 INFO [Listener at localhost.localdomain/44017] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-02-08 02:57:31,135 INFO [Listener at localhost.localdomain/44017] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1675825030808-1675825046330 2023-02-08 02:57:31,136 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:31,136 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:31,142 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(748): Client=jenkins//136.243.104.168 delete name: "hbase-failsafe-snaptb-1675825030808-1675825046330" 2023-02-08 02:57:31,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1675825030808-1675825046330 2023-02-08 02:57:31,147 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:31,147 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:31,148 INFO [Listener at localhost.localdomain/44017] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-02-08 02:57:31,151 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.HMaster$10(2372): Client=jenkins//136.243.104.168 enable testCompactionWithHFileLink 2023-02-08 02:57:31,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-02-08 02:57:31,160 INFO [PEWorker-3] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-02-08 02:57:31,160 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:31,160 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:31,160 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675825051160"}]},"ts":"1675825051160"} 2023-02-08 02:57:31,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-08 02:57:31,161 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-08 02:57:31,221 DEBUG [PEWorker-3] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-02-08 02:57:31,222 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9b6734a6d08c30735bfd45bd3735f0e9, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=12373e98d6fb3636c0d02a5815aad09c, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=903c5e7f299e5714b7640c3c91b635f1, ASSIGN}] 2023-02-08 02:57:31,223 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=903c5e7f299e5714b7640c3c91b635f1, ASSIGN 2023-02-08 02:57:31,224 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9b6734a6d08c30735bfd45bd3735f0e9, ASSIGN 2023-02-08 02:57:31,224 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=12373e98d6fb3636c0d02a5815aad09c, ASSIGN 2023-02-08 02:57:31,224 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=903c5e7f299e5714b7640c3c91b635f1, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-08 02:57:31,225 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9b6734a6d08c30735bfd45bd3735f0e9, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-08 02:57:31,225 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=12373e98d6fb3636c0d02a5815aad09c, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-08 02:57:31,261 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:31,261 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:31,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-08 02:57:31,377 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=12373e98d6fb3636c0d02a5815aad09c, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:31,377 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=9b6734a6d08c30735bfd45bd3735f0e9, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:31,377 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675825051377"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675825051377"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675825051377"}]},"ts":"1675825051377"} 2023-02-08 02:57:31,377 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675825051377"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675825051377"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675825051377"}]},"ts":"1675825051377"} 2023-02-08 02:57:31,377 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=903c5e7f299e5714b7640c3c91b635f1, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:31,377 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675825051377"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675825051377"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675825051377"}]},"ts":"1675825051377"} 2023-02-08 02:57:31,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=99, state=RUNNABLE; OpenRegionProcedure 12373e98d6fb3636c0d02a5815aad09c, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:57:31,379 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=98, state=RUNNABLE; OpenRegionProcedure 9b6734a6d08c30735bfd45bd3735f0e9, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:57:31,380 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; OpenRegionProcedure 903c5e7f299e5714b7640c3c91b635f1, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:57:31,462 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:31,462 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:31,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-08 02:57:31,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:31,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 903c5e7f299e5714b7640c3c91b635f1, NAME => 'testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1.', STARTKEY => '2', ENDKEY => ''} 2023-02-08 02:57:31,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 903c5e7f299e5714b7640c3c91b635f1 2023-02-08 02:57:31,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:57:31,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 903c5e7f299e5714b7640c3c91b635f1 2023-02-08 02:57:31,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 903c5e7f299e5714b7640c3c91b635f1 2023-02-08 02:57:31,539 INFO [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 903c5e7f299e5714b7640c3c91b635f1 2023-02-08 02:57:31,541 DEBUG [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1 2023-02-08 02:57:31,541 DEBUG [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1 2023-02-08 02:57:31,542 INFO [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 903c5e7f299e5714b7640c3c91b635f1 columnFamilyName family1 2023-02-08 02:57:31,563 DEBUG [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-0f553be334ff447186e0f65865546c5b 2023-02-08 02:57:31,568 DEBUG [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-3fe0ab37fbdd48999b8451a603110632 2023-02-08 02:57:31,574 DEBUG [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-50f7399a4dcf439196b9fe8cd2fc65e7 2023-02-08 02:57:31,580 DEBUG [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-f1caa80c1620447d8d23991baa2c637d 2023-02-08 02:57:31,580 INFO [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] regionserver.HStore(310): Store=903c5e7f299e5714b7640c3c91b635f1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:57:31,580 INFO [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 903c5e7f299e5714b7640c3c91b635f1 2023-02-08 02:57:31,581 DEBUG [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2 2023-02-08 02:57:31,581 DEBUG [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2 2023-02-08 02:57:31,582 INFO [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 903c5e7f299e5714b7640c3c91b635f1 columnFamilyName family2 2023-02-08 02:57:31,591 DEBUG [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-a9ce54357a1041f880875e4caf9dd161 2023-02-08 02:57:31,600 DEBUG [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-bbd943ef42be4b8e9e1f390166f32a71 2023-02-08 02:57:31,607 DEBUG [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-e0d003e600d74b55b221352e281d07b9 2023-02-08 02:57:31,613 DEBUG [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-ed556adc1747418f9d870d3e64080608 2023-02-08 02:57:31,613 INFO [StoreOpener-903c5e7f299e5714b7640c3c91b635f1-1] regionserver.HStore(310): Store=903c5e7f299e5714b7640c3c91b635f1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:57:31,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1 2023-02-08 02:57:31,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1 2023-02-08 02:57:31,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 02:57:31,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 903c5e7f299e5714b7640c3c91b635f1 2023-02-08 02:57:31,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 903c5e7f299e5714b7640c3c91b635f1; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66538535, jitterRate=-0.00849856436252594}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 02:57:31,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 903c5e7f299e5714b7640c3c91b635f1: Running coprocessor pre-open hook at 1675825051537Writing region info on filesystem at 1675825051537Initializing all the Stores at 1675825051538 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825051539 (+1 ms)Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825051539Cleaning up temporary data from old regions at 1675825051615 (+76 ms)Cleaning up detritus from prior splits at 1675825051616 (+1 ms)Running coprocessor post-open hooks at 1675825051618 (+2 ms)Region opened successfully at 1675825051618 2023-02-08 02:57:31,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1., pid=103, masterSystemTime=1675825051530 2023-02-08 02:57:31,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:57:31,619 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-08 02:57:31,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:57:31,620 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-08 02:57:31,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:31,621 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:31,621 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:31,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9b6734a6d08c30735bfd45bd3735f0e9, NAME => 'testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9.', STARTKEY => '', ENDKEY => '1'} 2023-02-08 02:57:31,621 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=903c5e7f299e5714b7640c3c91b635f1, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:31,621 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675825051621"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675825051621"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675825051621"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675825051621"}]},"ts":"1675825051621"} 2023-02-08 02:57:31,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 9b6734a6d08c30735bfd45bd3735f0e9 2023-02-08 02:57:31,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:57:31,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 9b6734a6d08c30735bfd45bd3735f0e9 2023-02-08 02:57:31,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 9b6734a6d08c30735bfd45bd3735f0e9 2023-02-08 02:57:31,622 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-08 02:57:31,622 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1912): 903c5e7f299e5714b7640c3c91b635f1/family1 is initiating minor compaction (all files) 2023-02-08 02:57:31,622 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-08 02:57:31,622 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.HStore(1912): 903c5e7f299e5714b7640c3c91b635f1/family2 is initiating minor compaction (all files) 2023-02-08 02:57:31,622 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 903c5e7f299e5714b7640c3c91b635f1/family1 in testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:31,622 INFO [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 903c5e7f299e5714b7640c3c91b635f1/family2 in testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:57:31,622 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-50f7399a4dcf439196b9fe8cd2fc65e7, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-f1caa80c1620447d8d23991baa2c637d, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-3fe0ab37fbdd48999b8451a603110632, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-0f553be334ff447186e0f65865546c5b] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp, totalSize=21.6 K 2023-02-08 02:57:31,622 INFO [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-bbd943ef42be4b8e9e1f390166f32a71, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-a9ce54357a1041f880875e4caf9dd161, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-e0d003e600d74b55b221352e281d07b9, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-ed556adc1747418f9d870d3e64080608] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp, totalSize=20.4 K 2023-02-08 02:57:31,623 INFO [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9b6734a6d08c30735bfd45bd3735f0e9 2023-02-08 02:57:31,623 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-50f7399a4dcf439196b9fe8cd2fc65e7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825023788 2023-02-08 02:57:31,623 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-bbd943ef42be4b8e9e1f390166f32a71, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825023788 2023-02-08 02:57:31,624 DEBUG [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1 2023-02-08 02:57:31,624 DEBUG [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1 2023-02-08 02:57:31,624 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-a9ce54357a1041f880875e4caf9dd161, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825024967 2023-02-08 02:57:31,624 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-02-08 02:57:31,624 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; OpenRegionProcedure 903c5e7f299e5714b7640c3c91b635f1, server=jenkins-hbase12.apache.org,44577,1675824910652 in 243 msec 2023-02-08 02:57:31,624 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-f1caa80c1620447d8d23991baa2c637d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825024967 2023-02-08 02:57:31,625 INFO [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b6734a6d08c30735bfd45bd3735f0e9 columnFamilyName family1 2023-02-08 02:57:31,625 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-e0d003e600d74b55b221352e281d07b9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825026845 2023-02-08 02:57:31,625 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-3fe0ab37fbdd48999b8451a603110632, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825026845 2023-02-08 02:57:31,625 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=903c5e7f299e5714b7640c3c91b635f1, ASSIGN in 402 msec 2023-02-08 02:57:31,625 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-ed556adc1747418f9d870d3e64080608, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825028833 2023-02-08 02:57:31,625 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-0f553be334ff447186e0f65865546c5b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825028833 2023-02-08 02:57:31,640 DEBUG [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-572417a992924edd9957eb1d317e11cd 2023-02-08 02:57:31,647 DEBUG [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-74ebb73f89444c198ac38e137c8ae954 2023-02-08 02:57:31,658 DEBUG [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-dcd3aca6561e4731a8a12ee6f7fc1a94 2023-02-08 02:57:31,663 INFO [RS:0;jenkins-hbase12:44577-longCompactions-0] throttle.PressureAwareThroughputController(145): 903c5e7f299e5714b7640c3c91b635f1#family2#compaction#115 average throughput is 0.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 53.85 MB/second 2023-02-08 02:57:31,665 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] throttle.PressureAwareThroughputController(145): 903c5e7f299e5714b7640c3c91b635f1#family1#compaction#114 average throughput is 0.26 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-08 02:57:31,673 DEBUG [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-eb2c7dbb4f14414f8338b35f68b559fa 2023-02-08 02:57:31,673 INFO [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] regionserver.HStore(310): Store=9b6734a6d08c30735bfd45bd3735f0e9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:57:31,673 INFO [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9b6734a6d08c30735bfd45bd3735f0e9 2023-02-08 02:57:31,674 DEBUG [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2 2023-02-08 02:57:31,674 DEBUG [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2 2023-02-08 02:57:31,675 INFO [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b6734a6d08c30735bfd45bd3735f0e9 columnFamilyName family2 2023-02-08 02:57:31,681 DEBUG [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-1261fadd0f6a42388a2307485b8ece65 2023-02-08 02:57:31,685 DEBUG [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-73a5743093994defa790b7b6a5f2d19f 2023-02-08 02:57:31,685 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family1/76a37dec79654449a00b9aefbdd17a05 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/76a37dec79654449a00b9aefbdd17a05 2023-02-08 02:57:31,689 DEBUG [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-a435d5cb4c88407f999a36ad8c766a28 2023-02-08 02:57:31,689 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 903c5e7f299e5714b7640c3c91b635f1/family1 of 903c5e7f299e5714b7640c3c91b635f1 into 76a37dec79654449a00b9aefbdd17a05(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 02:57:31,689 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 903c5e7f299e5714b7640c3c91b635f1: 2023-02-08 02:57:31,689 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1., storeName=903c5e7f299e5714b7640c3c91b635f1/family1, priority=12, startTime=1675825051619; duration=0sec 2023-02-08 02:57:31,689 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:57:31,693 DEBUG [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-b1187445590d4db3a7dfe57576d45090 2023-02-08 02:57:31,693 INFO [StoreOpener-9b6734a6d08c30735bfd45bd3735f0e9-1] regionserver.HStore(310): Store=9b6734a6d08c30735bfd45bd3735f0e9/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:57:31,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9 2023-02-08 02:57:31,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9 2023-02-08 02:57:31,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 02:57:31,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 9b6734a6d08c30735bfd45bd3735f0e9 2023-02-08 02:57:31,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 9b6734a6d08c30735bfd45bd3735f0e9; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59240112, jitterRate=-0.11725354194641113}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 02:57:31,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 9b6734a6d08c30735bfd45bd3735f0e9: Running coprocessor pre-open hook at 1675825051622Writing region info on filesystem at 1675825051622Initializing all the Stores at 1675825051622Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825051622Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825051622Cleaning up temporary data from old regions at 1675825051695 (+73 ms)Cleaning up detritus from prior splits at 1675825051695Running coprocessor post-open hooks at 1675825051697 (+2 ms)Region opened successfully at 1675825051697 2023-02-08 02:57:31,698 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9., pid=102, masterSystemTime=1675825051530 2023-02-08 02:57:31,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-08 02:57:31,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-08 02:57:31,698 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-08 02:57:31,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:31,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:31,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:31,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 12373e98d6fb3636c0d02a5815aad09c, NAME => 'testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c.', STARTKEY => '1', ENDKEY => '2'} 2023-02-08 02:57:31,700 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=9b6734a6d08c30735bfd45bd3735f0e9, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:31,700 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675825051700"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675825051700"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675825051700"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675825051700"}]},"ts":"1675825051700"} 2023-02-08 02:57:31,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 12373e98d6fb3636c0d02a5815aad09c 2023-02-08 02:57:31,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:57:31,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 12373e98d6fb3636c0d02a5815aad09c 2023-02-08 02:57:31,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 12373e98d6fb3636c0d02a5815aad09c 2023-02-08 02:57:31,700 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-08 02:57:31,700 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1912): 9b6734a6d08c30735bfd45bd3735f0e9/family1 is initiating minor compaction (all files) 2023-02-08 02:57:31,701 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 9b6734a6d08c30735bfd45bd3735f0e9/family1 in testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:31,701 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-572417a992924edd9957eb1d317e11cd, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-74ebb73f89444c198ac38e137c8ae954, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-dcd3aca6561e4731a8a12ee6f7fc1a94, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-eb2c7dbb4f14414f8338b35f68b559fa] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp, totalSize=21.6 K 2023-02-08 02:57:31,701 INFO [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 12373e98d6fb3636c0d02a5815aad09c 2023-02-08 02:57:31,701 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-572417a992924edd9957eb1d317e11cd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825023787 2023-02-08 02:57:31,702 DEBUG [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1 2023-02-08 02:57:31,702 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-74ebb73f89444c198ac38e137c8ae954, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825024966 2023-02-08 02:57:31,702 DEBUG [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1 2023-02-08 02:57:31,702 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=98 2023-02-08 02:57:31,702 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=98, state=SUCCESS; OpenRegionProcedure 9b6734a6d08c30735bfd45bd3735f0e9, server=jenkins-hbase12.apache.org,44577,1675824910652 in 322 msec 2023-02-08 02:57:31,702 INFO [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12373e98d6fb3636c0d02a5815aad09c columnFamilyName family1 2023-02-08 02:57:31,702 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-dcd3aca6561e4731a8a12ee6f7fc1a94, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825026843 2023-02-08 02:57:31,703 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-eb2c7dbb4f14414f8338b35f68b559fa, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825028832 2023-02-08 02:57:31,704 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9b6734a6d08c30735bfd45bd3735f0e9, ASSIGN in 480 msec 2023-02-08 02:57:31,708 DEBUG [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-05d45fa5b0704cd699922167246d4cd0 2023-02-08 02:57:31,712 DEBUG [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-3c3fa3a23f91414183577cd2042f12eb 2023-02-08 02:57:31,716 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-50f7399a4dcf439196b9fe8cd2fc65e7, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-f1caa80c1620447d8d23991baa2c637d, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-3fe0ab37fbdd48999b8451a603110632, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-0f553be334ff447186e0f65865546c5b] to archive 2023-02-08 02:57:31,717 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:31,720 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-50f7399a4dcf439196b9fe8cd2fc65e7 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-50f7399a4dcf439196b9fe8cd2fc65e7 2023-02-08 02:57:31,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-f1caa80c1620447d8d23991baa2c637d to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-f1caa80c1620447d8d23991baa2c637d 2023-02-08 02:57:31,722 DEBUG [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-4408b3d2330549328be2f2cd48bba925 2023-02-08 02:57:31,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-3fe0ab37fbdd48999b8451a603110632 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-3fe0ab37fbdd48999b8451a603110632 2023-02-08 02:57:31,722 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9b6734a6d08c30735bfd45bd3735f0e9#family1#compaction#116 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-08 02:57:31,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-0f553be334ff447186e0f65865546c5b to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-0f553be334ff447186e0f65865546c5b 2023-02-08 02:57:31,731 DEBUG [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-bc906f7bf326433f8c5843320d441c07 2023-02-08 02:57:31,731 INFO [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] regionserver.HStore(310): Store=12373e98d6fb3636c0d02a5815aad09c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:57:31,731 INFO [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 12373e98d6fb3636c0d02a5815aad09c 2023-02-08 02:57:31,732 DEBUG [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2 2023-02-08 02:57:31,732 DEBUG [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2 2023-02-08 02:57:31,732 INFO [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12373e98d6fb3636c0d02a5815aad09c columnFamilyName family2 2023-02-08 02:57:31,738 DEBUG [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-2647224f0b9c40f4ae812131560548d9 2023-02-08 02:57:31,741 DEBUG [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-29aa81036d3b45c7a1fc8d92d034bdbd 2023-02-08 02:57:31,745 DEBUG [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-85cfdba51b0e4e10a82b14a5c1ae483b 2023-02-08 02:57:31,748 DEBUG [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-928cc4c90d034ecb865bc59f9c995a98 2023-02-08 02:57:31,748 INFO [StoreOpener-12373e98d6fb3636c0d02a5815aad09c-1] regionserver.HStore(310): Store=12373e98d6fb3636c0d02a5815aad09c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:57:31,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c 2023-02-08 02:57:31,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c 2023-02-08 02:57:31,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 02:57:31,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 12373e98d6fb3636c0d02a5815aad09c 2023-02-08 02:57:31,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 12373e98d6fb3636c0d02a5815aad09c; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65308351, jitterRate=-0.026829734444618225}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 02:57:31,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 12373e98d6fb3636c0d02a5815aad09c: Running coprocessor pre-open hook at 1675825051700Writing region info on filesystem at 1675825051700Initializing all the Stores at 1675825051701 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825051701Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825051701Cleaning up temporary data from old regions at 1675825051750 (+49 ms)Cleaning up detritus from prior splits at 1675825051750Running coprocessor post-open hooks at 1675825051752 (+2 ms)Region opened successfully at 1675825051752 2023-02-08 02:57:31,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c., pid=101, masterSystemTime=1675825051530 2023-02-08 02:57:31,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-08 02:57:31,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-08 02:57:31,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:31,754 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:31,754 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=12373e98d6fb3636c0d02a5815aad09c, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:31,754 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675825051754"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675825051754"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675825051754"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675825051754"}]},"ts":"1675825051754"} 2023-02-08 02:57:31,756 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-02-08 02:57:31,756 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; OpenRegionProcedure 12373e98d6fb3636c0d02a5815aad09c, server=jenkins-hbase12.apache.org,44577,1675824910652 in 376 msec 2023-02-08 02:57:31,757 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=99, resume processing ppid=97 2023-02-08 02:57:31,757 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=12373e98d6fb3636c0d02a5815aad09c, ASSIGN in 534 msec 2023-02-08 02:57:31,758 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675825051758"}]},"ts":"1675825051758"} 2023-02-08 02:57:31,759 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-08 02:57:31,763 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:31,763 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:31,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-08 02:57:31,775 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 02:57:31,810 INFO [PEWorker-5] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-02-08 02:57:31,811 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 657 msec 2023-02-08 02:57:32,264 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:32,264 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:32,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-08 02:57:32,267 INFO [Listener at localhost.localdomain/44017] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-02-08 02:57:32,289 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 02:57:32,297 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 02:57:32,303 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 02:57:32,304 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 02:57:32,310 INFO [Listener at localhost.localdomain/44017] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-08 02:57:32,328 INFO [Listener at localhost.localdomain/44017] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-08 02:57:32,329 INFO [Listener at localhost.localdomain/44017] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-08 02:57:32,329 DEBUG [Listener at localhost.localdomain/44017] zookeeper.ReadOnlyZKClient(139): Connect 0x236b9d91 to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:57:32,412 DEBUG [Listener at localhost.localdomain/44017] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c4728df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:57:32,412 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 02:57:32,412 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 02:57:32,412 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 02:57:32,462 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302084c93ae4ef244456ea54d0873b59a0559 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302084c93ae4ef244456ea54d0873b59a0559 2023-02-08 02:57:32,462 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 02:57:32,472 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 02:57:32,475 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:39760, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 02:57:32,480 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:32,480 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:32,480 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 02:57:32,483 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:60764, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 02:57:32,500 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230208/family1/9098c5400def4e858f67a5d2649f3f63 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-02-08 02:57:32,500 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230208/family1/9098c5400def4e858f67a5d2649f3f63}] 2023-02-08 02:57:32,506 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230208/family1/9098c5400def4e858f67a5d2649f3f63 for inclusion in 903c5e7f299e5714b7640c3c91b635f1/family1 2023-02-08 02:57:32,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-02-08 02:57:32,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-08 02:57:32,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for 903c5e7f299e5714b7640c3c91b635f1: 2023-02-08 02:57:32,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230208/family1/9098c5400def4e858f67a5d2649f3f63 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__8rgqu0d6ico2cnmas1q9lb28g6n2l70r21f1tadhq4dbm9ruov05gggj1jbdae58/family1/9098c5400def4e858f67a5d2649f3f63 2023-02-08 02:57:32,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__8rgqu0d6ico2cnmas1q9lb28g6n2l70r21f1tadhq4dbm9ruov05gggj1jbdae58/family1/9098c5400def4e858f67a5d2649f3f63 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/e182a1f724794c73a61ac8c39c485597_SeqId_35_ 2023-02-08 02:57:32,511 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__8rgqu0d6ico2cnmas1q9lb28g6n2l70r21f1tadhq4dbm9ruov05gggj1jbdae58/family1/9098c5400def4e858f67a5d2649f3f63 into 903c5e7f299e5714b7640c3c91b635f1/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/e182a1f724794c73a61ac8c39c485597_SeqId_35_ - updating store file list. 2023-02-08 02:57:32,514 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/e182a1f724794c73a61ac8c39c485597_SeqId_35_ into 903c5e7f299e5714b7640c3c91b635f1/family1 2023-02-08 02:57:32,514 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__8rgqu0d6ico2cnmas1q9lb28g6n2l70r21f1tadhq4dbm9ruov05gggj1jbdae58/family1/9098c5400def4e858f67a5d2649f3f63 into 903c5e7f299e5714b7640c3c91b635f1/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family1/e182a1f724794c73a61ac8c39c485597_SeqId_35_) 2023-02-08 02:57:32,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__8rgqu0d6ico2cnmas1q9lb28g6n2l70r21f1tadhq4dbm9ruov05gggj1jbdae58/family1/9098c5400def4e858f67a5d2649f3f63 2023-02-08 02:57:32,516 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 02:57:32,517 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:32,518 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023020850a5b5a2593a4e958246e5e0bec02dd5 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023020850a5b5a2593a4e958246e5e0bec02dd5 2023-02-08 02:57:32,519 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230208a194b2886199442282b4ff0e357620d1 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230208a194b2886199442282b4ff0e357620d1 2023-02-08 02:57:32,520 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230208a9cce4b809f844d5a20945726625d298 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230208a9cce4b809f844d5a20945726625d298 2023-02-08 02:57:32,521 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230208c1546cb71c164793acead2f5a9ecc4b9 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230208c1546cb71c164793acead2f5a9ecc4b9 2023-02-08 02:57:32,521 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-08 02:57:32,521 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230208' 2023-02-08 02:57:32,521 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 02:57:32,900 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/.tmp/family2/3ff7c19f29d843ed80c473efed25e64c as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/3ff7c19f29d843ed80c473efed25e64c 2023-02-08 02:57:32,904 INFO [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 903c5e7f299e5714b7640c3c91b635f1/family2 of 903c5e7f299e5714b7640c3c91b635f1 into 3ff7c19f29d843ed80c473efed25e64c(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:57:32,904 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 903c5e7f299e5714b7640c3c91b635f1: 2023-02-08 02:57:32,904 INFO [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1., storeName=903c5e7f299e5714b7640c3c91b635f1/family2, priority=12, startTime=1675825051619; duration=1sec 2023-02-08 02:57:32,904 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-08 02:57:32,904 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-08 02:57:32,906 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-08 02:57:32,906 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.HStore(1912): 9b6734a6d08c30735bfd45bd3735f0e9/family2 is initiating minor compaction (all files) 2023-02-08 02:57:32,906 INFO [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 9b6734a6d08c30735bfd45bd3735f0e9/family2 in testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:57:32,906 INFO [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-b1187445590d4db3a7dfe57576d45090, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-1261fadd0f6a42388a2307485b8ece65, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-a435d5cb4c88407f999a36ad8c766a28, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-73a5743093994defa790b7b6a5f2d19f] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp, totalSize=20.4 K 2023-02-08 02:57:32,907 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-b1187445590d4db3a7dfe57576d45090, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825023787 2023-02-08 02:57:32,907 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-1261fadd0f6a42388a2307485b8ece65, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825024966 2023-02-08 02:57:32,908 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-a435d5cb4c88407f999a36ad8c766a28, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825026843 2023-02-08 02:57:32,908 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-73a5743093994defa790b7b6a5f2d19f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825028832 2023-02-08 02:57:32,919 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-bbd943ef42be4b8e9e1f390166f32a71, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-a9ce54357a1041f880875e4caf9dd161, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-e0d003e600d74b55b221352e281d07b9, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-ed556adc1747418f9d870d3e64080608] to archive 2023-02-08 02:57:32,920 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:32,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-bbd943ef42be4b8e9e1f390166f32a71 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-bbd943ef42be4b8e9e1f390166f32a71 2023-02-08 02:57:32,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-a9ce54357a1041f880875e4caf9dd161 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-a9ce54357a1041f880875e4caf9dd161 2023-02-08 02:57:32,925 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-e0d003e600d74b55b221352e281d07b9 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-e0d003e600d74b55b221352e281d07b9 2023-02-08 02:57:32,926 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-ed556adc1747418f9d870d3e64080608 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/family2/testCompactionWithHFileLink=903c5e7f299e5714b7640c3c91b635f1-ed556adc1747418f9d870d3e64080608 2023-02-08 02:57:32,928 INFO [RS:0;jenkins-hbase12:44577-longCompactions-0] throttle.PressureAwareThroughputController(145): 9b6734a6d08c30735bfd45bd3735f0e9#family2#compaction#117 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-08 02:57:32,940 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family1/61ce6039a31c4addbe8770191f1d8ead as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/61ce6039a31c4addbe8770191f1d8ead 2023-02-08 02:57:32,946 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 9b6734a6d08c30735bfd45bd3735f0e9/family1 of 9b6734a6d08c30735bfd45bd3735f0e9 into 61ce6039a31c4addbe8770191f1d8ead(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:57:32,946 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 9b6734a6d08c30735bfd45bd3735f0e9: 2023-02-08 02:57:32,946 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9., storeName=9b6734a6d08c30735bfd45bd3735f0e9/family1, priority=12, startTime=1675825051698; duration=1sec 2023-02-08 02:57:32,946 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-08 02:57:32,946 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-08 02:57:32,948 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-08 02:57:32,949 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1912): 12373e98d6fb3636c0d02a5815aad09c/family2 is initiating minor compaction (all files) 2023-02-08 02:57:32,949 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 12373e98d6fb3636c0d02a5815aad09c/family2 in testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:32,949 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-928cc4c90d034ecb865bc59f9c995a98, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-85cfdba51b0e4e10a82b14a5c1ae483b, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-2647224f0b9c40f4ae812131560548d9, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-29aa81036d3b45c7a1fc8d92d034bdbd] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp, totalSize=20.4 K 2023-02-08 02:57:32,949 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-928cc4c90d034ecb865bc59f9c995a98, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825023788 2023-02-08 02:57:32,950 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-85cfdba51b0e4e10a82b14a5c1ae483b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825024967 2023-02-08 02:57:32,950 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-2647224f0b9c40f4ae812131560548d9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825026844 2023-02-08 02:57:32,951 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-29aa81036d3b45c7a1fc8d92d034bdbd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825028832 2023-02-08 02:57:32,961 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] throttle.PressureAwareThroughputController(145): 12373e98d6fb3636c0d02a5815aad09c#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-08 02:57:33,021 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-572417a992924edd9957eb1d317e11cd, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-74ebb73f89444c198ac38e137c8ae954, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-dcd3aca6561e4731a8a12ee6f7fc1a94, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-eb2c7dbb4f14414f8338b35f68b559fa] to archive 2023-02-08 02:57:33,022 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:33,024 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-572417a992924edd9957eb1d317e11cd to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-572417a992924edd9957eb1d317e11cd 2023-02-08 02:57:33,025 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-74ebb73f89444c198ac38e137c8ae954 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-74ebb73f89444c198ac38e137c8ae954 2023-02-08 02:57:33,026 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-dcd3aca6561e4731a8a12ee6f7fc1a94 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-dcd3aca6561e4731a8a12ee6f7fc1a94 2023-02-08 02:57:33,027 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-eb2c7dbb4f14414f8338b35f68b559fa to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-eb2c7dbb4f14414f8338b35f68b559fa 2023-02-08 02:57:33,306 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302088828e80c783842edae30776af10f2627 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302088828e80c783842edae30776af10f2627 2023-02-08 02:57:33,306 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302082eb066d0147d48eab4d6127f81fc3172 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302082eb066d0147d48eab4d6127f81fc3172 2023-02-08 02:57:33,307 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 02:57:33,307 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 02:57:33,329 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:33,329 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:33,329 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:33,329 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:33,340 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230208/family1/95e090beca594667aabfe875006fd506 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-02-08 02:57:33,340 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230208/family1/8ce5e0ce19dd4f859609c18573713fb4 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-02-08 02:57:33,341 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=32 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230208/family1/8ce5e0ce19dd4f859609c18573713fb4}] 2023-02-08 02:57:33,341 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230208/family1/95e090beca594667aabfe875006fd506}] 2023-02-08 02:57:33,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230208/family1/8ce5e0ce19dd4f859609c18573713fb4 for inclusion in 9b6734a6d08c30735bfd45bd3735f0e9/family1 2023-02-08 02:57:33,344 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230208/family1/95e090beca594667aabfe875006fd506 for inclusion in 12373e98d6fb3636c0d02a5815aad09c/family1 2023-02-08 02:57:33,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-02-08 02:57:33,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-02-08 02:57:33,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last=1 2023-02-08 02:57:33,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-08 02:57:33,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for 9b6734a6d08c30735bfd45bd3735f0e9: 2023-02-08 02:57:33,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for 12373e98d6fb3636c0d02a5815aad09c: 2023-02-08 02:57:33,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230208/family1/95e090beca594667aabfe875006fd506 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__8gi24oh9t3194er17tfdrsbassj28uqlu6pjqt4bt2ujkm7lmdhphje0iaif43l6/family1/95e090beca594667aabfe875006fd506 2023-02-08 02:57:33,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230208/family1/8ce5e0ce19dd4f859609c18573713fb4 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__5ej3m5ccaam6279dd0o0k5bobak4iqnabv4i1mpb8pn4thl6bua2ltotpg302jur/family1/8ce5e0ce19dd4f859609c18573713fb4 2023-02-08 02:57:33,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__8gi24oh9t3194er17tfdrsbassj28uqlu6pjqt4bt2ujkm7lmdhphje0iaif43l6/family1/95e090beca594667aabfe875006fd506 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/fbd6bbd79a8d4ec385b0a337286a3491_SeqId_34_ 2023-02-08 02:57:33,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__5ej3m5ccaam6279dd0o0k5bobak4iqnabv4i1mpb8pn4thl6bua2ltotpg302jur/family1/8ce5e0ce19dd4f859609c18573713fb4 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/9fc8fb2c01d244d79752671dac47729f_SeqId_35_ 2023-02-08 02:57:33,348 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__8gi24oh9t3194er17tfdrsbassj28uqlu6pjqt4bt2ujkm7lmdhphje0iaif43l6/family1/95e090beca594667aabfe875006fd506 into 12373e98d6fb3636c0d02a5815aad09c/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/fbd6bbd79a8d4ec385b0a337286a3491_SeqId_34_ - updating store file list. 2023-02-08 02:57:33,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__5ej3m5ccaam6279dd0o0k5bobak4iqnabv4i1mpb8pn4thl6bua2ltotpg302jur/family1/8ce5e0ce19dd4f859609c18573713fb4 into 9b6734a6d08c30735bfd45bd3735f0e9/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/9fc8fb2c01d244d79752671dac47729f_SeqId_35_ - updating store file list. 2023-02-08 02:57:33,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/9fc8fb2c01d244d79752671dac47729f_SeqId_35_ into 9b6734a6d08c30735bfd45bd3735f0e9/family1 2023-02-08 02:57:33,352 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/fbd6bbd79a8d4ec385b0a337286a3491_SeqId_34_ into 12373e98d6fb3636c0d02a5815aad09c/family1 2023-02-08 02:57:33,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__5ej3m5ccaam6279dd0o0k5bobak4iqnabv4i1mpb8pn4thl6bua2ltotpg302jur/family1/8ce5e0ce19dd4f859609c18573713fb4 into 9b6734a6d08c30735bfd45bd3735f0e9/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family1/9fc8fb2c01d244d79752671dac47729f_SeqId_35_) 2023-02-08 02:57:33,352 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__8gi24oh9t3194er17tfdrsbassj28uqlu6pjqt4bt2ujkm7lmdhphje0iaif43l6/family1/95e090beca594667aabfe875006fd506 into 12373e98d6fb3636c0d02a5815aad09c/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/fbd6bbd79a8d4ec385b0a337286a3491_SeqId_34_) 2023-02-08 02:57:33,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__5ej3m5ccaam6279dd0o0k5bobak4iqnabv4i1mpb8pn4thl6bua2ltotpg302jur/family1/8ce5e0ce19dd4f859609c18573713fb4 2023-02-08 02:57:33,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testCompactionWithHFileLink__8gi24oh9t3194er17tfdrsbassj28uqlu6pjqt4bt2ujkm7lmdhphje0iaif43l6/family1/95e090beca594667aabfe875006fd506 2023-02-08 02:57:33,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 02:57:33,354 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 02:57:33,354 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:33,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-08 02:57:33,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(1912): 12373e98d6fb3636c0d02a5815aad09c/family1 is initiating minor compaction (all files) 2023-02-08 02:57:33,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6f994349; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-08 02:57:33,356 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302085df9d34cb6554b4fa10790c14470f5e4 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302085df9d34cb6554b4fa10790c14470f5e4 2023-02-08 02:57:33,357 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 02:57:33,357 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302086d9a7bcab1264e5a94d350c136fe2526 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302086d9a7bcab1264e5a94d350c136fe2526 2023-02-08 02:57:33,358 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:33,358 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230208efbe5934e4f048bebf5ddcd5da7d15f0 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230208efbe5934e4f048bebf5ddcd5da7d15f0 2023-02-08 02:57:33,359 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302082abfaffeee9d47f4b7a06bf1946c7473 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302082abfaffeee9d47f4b7a06bf1946c7473 2023-02-08 02:57:33,359 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230208f249b02e92304f509f6beea9cb102a37 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230208f249b02e92304f509f6beea9cb102a37 2023-02-08 02:57:33,359 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-08 02:57:33,359 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230208' 2023-02-08 02:57:33,360 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 02:57:33,360 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302083b0c47ca4c3c415595ff61688d27604f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302083b0c47ca4c3c415595ff61688d27604f 2023-02-08 02:57:33,361 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023020864f2f309fbcf47d3ba43dfd77a0618eb to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023020864f2f309fbcf47d3ba43dfd77a0618eb 2023-02-08 02:57:33,362 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230208fb0cde7d75254f838f6d87d16d755d49 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230208fb0cde7d75254f838f6d87d16d755d49 2023-02-08 02:57:33,362 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-08 02:57:33,362 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230208' 2023-02-08 02:57:33,363 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 02:57:33,363 INFO [Listener at localhost.localdomain/44017] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-08 02:57:33,368 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 02:57:33,371 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 02:57:33,376 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 02:57:33,377 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 02:57:33,382 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 02:57:33,383 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 02:57:33,399 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=271 (was 235) - Thread LEAK? -, OpenFileDescriptor=734 (was 596) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=118 (was 115) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 172), AvailableMemoryMB=3228 (was 3331) 2023-02-08 02:57:33,410 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=271, OpenFileDescriptor=734, MaxFileDescriptor=60000, SystemLoadAverage=118, ProcessCount=171, AvailableMemoryMB=3227 2023-02-08 02:57:33,412 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:33,412 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:33,415 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.HMaster$15(2997): Client=jenkins//136.243.104.168 creating {NAME => 'ns'} 2023-02-08 02:57:33,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-02-08 02:57:33,421 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:33,421 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:33,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-08 02:57:33,473 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 02:57:33,487 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 69 msec 2023-02-08 02:57:33,522 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:33,522 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:33,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-08 02:57:33,523 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:33,523 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:33,525 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-08 02:57:33,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-02-08 02:57:33,527 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 02:57:33,527 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-02-08 02:57:33,528 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:33,528 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:33,528 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 02:57:33,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-08 02:57:33,530 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a 2023-02-08 02:57:33,530 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274 2023-02-08 02:57:33,530 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde 2023-02-08 02:57:33,531 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a empty. 2023-02-08 02:57:33,531 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274 empty. 2023-02-08 02:57:33,531 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde empty. 2023-02-08 02:57:33,531 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a 2023-02-08 02:57:33,531 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274 2023-02-08 02:57:33,531 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde 2023-02-08 02:57:33,531 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-02-08 02:57:33,629 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:33,629 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:33,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-08 02:57:33,758 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/.tmp/family2/69e30f2380004e44a32e13a4e5a2f65c as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/69e30f2380004e44a32e13a4e5a2f65c 2023-02-08 02:57:33,762 INFO [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 9b6734a6d08c30735bfd45bd3735f0e9/family2 of 9b6734a6d08c30735bfd45bd3735f0e9 into 69e30f2380004e44a32e13a4e5a2f65c(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 02:57:33,762 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 9b6734a6d08c30735bfd45bd3735f0e9: 2023-02-08 02:57:33,762 INFO [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9., storeName=9b6734a6d08c30735bfd45bd3735f0e9/family2, priority=12, startTime=1675825051698; duration=0sec 2023-02-08 02:57:33,762 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-08 02:57:33,762 INFO [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 12373e98d6fb3636c0d02a5815aad09c/family1 in testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:57:33,762 INFO [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-05d45fa5b0704cd699922167246d4cd0, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-4408b3d2330549328be2f2cd48bba925, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-bc906f7bf326433f8c5843320d441c07, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-3c3fa3a23f91414183577cd2042f12eb, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/fbd6bbd79a8d4ec385b0a337286a3491_SeqId_34_] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp, totalSize=28.9 K 2023-02-08 02:57:33,763 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-05d45fa5b0704cd699922167246d4cd0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825023788 2023-02-08 02:57:33,763 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-4408b3d2330549328be2f2cd48bba925, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825024967 2023-02-08 02:57:33,764 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-bc906f7bf326433f8c5843320d441c07, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825026844 2023-02-08 02:57:33,764 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-3c3fa3a23f91414183577cd2042f12eb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825028832 2023-02-08 02:57:33,765 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] compactions.Compactor(207): Compacting fbd6bbd79a8d4ec385b0a337286a3491_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1675825023788 2023-02-08 02:57:33,777 INFO [RS:0;jenkins-hbase12:44577-longCompactions-0] throttle.PressureAwareThroughputController(145): 12373e98d6fb3636c0d02a5815aad09c#family1#compaction#119 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-08 02:57:33,779 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family2/5d896e38a0bd4b01a74a4fa783cba2b1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/5d896e38a0bd4b01a74a4fa783cba2b1 2023-02-08 02:57:33,783 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 12373e98d6fb3636c0d02a5815aad09c/family2 of 12373e98d6fb3636c0d02a5815aad09c into 5d896e38a0bd4b01a74a4fa783cba2b1(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 02:57:33,783 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 12373e98d6fb3636c0d02a5815aad09c: 2023-02-08 02:57:33,783 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c., storeName=12373e98d6fb3636c0d02a5815aad09c/family2, priority=12, startTime=1675825051753; duration=0sec 2023-02-08 02:57:33,783 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-08 02:57:33,783 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-02-08 02:57:33,783 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-08 02:57:33,783 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-08 02:57:33,783 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. because compaction request was cancelled 2023-02-08 02:57:33,827 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-928cc4c90d034ecb865bc59f9c995a98, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-85cfdba51b0e4e10a82b14a5c1ae483b, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-2647224f0b9c40f4ae812131560548d9, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-29aa81036d3b45c7a1fc8d92d034bdbd] to archive 2023-02-08 02:57:33,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:33,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-928cc4c90d034ecb865bc59f9c995a98 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-928cc4c90d034ecb865bc59f9c995a98 2023-02-08 02:57:33,832 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:33,832 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:33,832 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-85cfdba51b0e4e10a82b14a5c1ae483b to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-85cfdba51b0e4e10a82b14a5c1ae483b 2023-02-08 02:57:33,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-08 02:57:33,833 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-2647224f0b9c40f4ae812131560548d9 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-2647224f0b9c40f4ae812131560548d9 2023-02-08 02:57:33,834 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-29aa81036d3b45c7a1fc8d92d034bdbd to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family2/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-29aa81036d3b45c7a1fc8d92d034bdbd 2023-02-08 02:57:33,835 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-b1187445590d4db3a7dfe57576d45090, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-1261fadd0f6a42388a2307485b8ece65, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-a435d5cb4c88407f999a36ad8c766a28, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-73a5743093994defa790b7b6a5f2d19f] to archive 2023-02-08 02:57:33,835 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:33,836 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-b1187445590d4db3a7dfe57576d45090 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-b1187445590d4db3a7dfe57576d45090 2023-02-08 02:57:33,837 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-1261fadd0f6a42388a2307485b8ece65 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-1261fadd0f6a42388a2307485b8ece65 2023-02-08 02:57:33,838 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-a435d5cb4c88407f999a36ad8c766a28 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-a435d5cb4c88407f999a36ad8c766a28 2023-02-08 02:57:33,839 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-73a5743093994defa790b7b6a5f2d19f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/family2/testCompactionWithHFileLink=9b6734a6d08c30735bfd45bd3735f0e9-73a5743093994defa790b7b6a5f2d19f 2023-02-08 02:57:33,941 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-02-08 02:57:33,944 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => 78af5cf8f1dc144d3a534e1053ebf08a, NAME => 'ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp 2023-02-08 02:57:33,945 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7671): creating {ENCODED => 1fe7fcbdd2a405d19a8041aa386a9bde, NAME => 'ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp 2023-02-08 02:57:33,946 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7671): creating {ENCODED => 56fee2d3c0105f54ac56ad88bfb2a274, NAME => 'ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp 2023-02-08 02:57:34,133 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:34,133 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:34,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-08 02:57:34,355 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:57:34,355 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:57:34,355 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1603): Closing 1fe7fcbdd2a405d19a8041aa386a9bde, disabling compactions & flushes 2023-02-08 02:57:34,356 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:57:34,356 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:57:34,356 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. after waiting 0 ms 2023-02-08 02:57:34,356 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1603): Closing 78af5cf8f1dc144d3a534e1053ebf08a, disabling compactions & flushes 2023-02-08 02:57:34,356 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:57:34,356 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:57:34,356 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. after waiting 0 ms 2023-02-08 02:57:34,356 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:57:34,357 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:57:34,357 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1603): Closing 56fee2d3c0105f54ac56ad88bfb2a274, disabling compactions & flushes 2023-02-08 02:57:34,357 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:57:34,357 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:57:34,357 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. after waiting 0 ms 2023-02-08 02:57:34,357 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:57:34,356 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:57:34,358 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:57:34,357 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:57:34,357 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:57:34,358 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1557): Region close journal for 56fee2d3c0105f54ac56ad88bfb2a274: Waiting for close lock at 1675825054357Disabling compacts and flushes for region at 1675825054357Disabling writes for close at 1675825054357Writing region close event to WAL at 1675825054357Closed at 1675825054357 2023-02-08 02:57:34,358 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1557): Region close journal for 1fe7fcbdd2a405d19a8041aa386a9bde: Waiting for close lock at 1675825054355Disabling compacts and flushes for region at 1675825054355Disabling writes for close at 1675825054356 (+1 ms)Writing region close event to WAL at 1675825054357 (+1 ms)Closed at 1675825054358 (+1 ms) 2023-02-08 02:57:34,358 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1557): Region close journal for 78af5cf8f1dc144d3a534e1053ebf08a: Waiting for close lock at 1675825054356Disabling compacts and flushes for region at 1675825054356Disabling writes for close at 1675825054357 (+1 ms)Writing region close event to WAL at 1675825054357Closed at 1675825054357 2023-02-08 02:57:34,362 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 02:57:34,364 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1675825054363"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675825054363"}]},"ts":"1675825054363"} 2023-02-08 02:57:34,364 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675825054363"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675825054363"}]},"ts":"1675825054363"} 2023-02-08 02:57:34,364 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675825054363"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675825054363"}]},"ts":"1675825054363"} 2023-02-08 02:57:34,367 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-08 02:57:34,368 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 02:57:34,368 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675825054368"}]},"ts":"1675825054368"} 2023-02-08 02:57:34,369 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-02-08 02:57:34,431 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=78af5cf8f1dc144d3a534e1053ebf08a, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=56fee2d3c0105f54ac56ad88bfb2a274, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1fe7fcbdd2a405d19a8041aa386a9bde, ASSIGN}] 2023-02-08 02:57:34,434 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=56fee2d3c0105f54ac56ad88bfb2a274, ASSIGN 2023-02-08 02:57:34,434 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=78af5cf8f1dc144d3a534e1053ebf08a, ASSIGN 2023-02-08 02:57:34,434 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1fe7fcbdd2a405d19a8041aa386a9bde, ASSIGN 2023-02-08 02:57:34,435 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=78af5cf8f1dc144d3a534e1053ebf08a, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=false 2023-02-08 02:57:34,435 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=56fee2d3c0105f54ac56ad88bfb2a274, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=false 2023-02-08 02:57:34,436 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1fe7fcbdd2a405d19a8041aa386a9bde, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=false 2023-02-08 02:57:34,591 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=1fe7fcbdd2a405d19a8041aa386a9bde, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:34,591 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=56fee2d3c0105f54ac56ad88bfb2a274, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:34,591 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=78af5cf8f1dc144d3a534e1053ebf08a, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:34,592 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675825054591"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675825054591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675825054591"}]},"ts":"1675825054591"} 2023-02-08 02:57:34,592 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675825054591"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675825054591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675825054591"}]},"ts":"1675825054591"} 2023-02-08 02:57:34,592 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1675825054591"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675825054591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675825054591"}]},"ts":"1675825054591"} 2023-02-08 02:57:34,596 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=108, state=RUNNABLE; OpenRegionProcedure 1fe7fcbdd2a405d19a8041aa386a9bde, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:57:34,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure 78af5cf8f1dc144d3a534e1053ebf08a, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:57:34,597 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure 56fee2d3c0105f54ac56ad88bfb2a274, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:57:34,636 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:34,636 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:34,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-08 02:57:34,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:57:34,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1fe7fcbdd2a405d19a8041aa386a9bde, NAME => 'ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde.', STARTKEY => '2', ENDKEY => ''} 2023-02-08 02:57:34,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 1fe7fcbdd2a405d19a8041aa386a9bde 2023-02-08 02:57:34,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:57:34,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 1fe7fcbdd2a405d19a8041aa386a9bde 2023-02-08 02:57:34,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 1fe7fcbdd2a405d19a8041aa386a9bde 2023-02-08 02:57:34,761 INFO [StoreOpener-1fe7fcbdd2a405d19a8041aa386a9bde-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1fe7fcbdd2a405d19a8041aa386a9bde 2023-02-08 02:57:34,763 DEBUG [StoreOpener-1fe7fcbdd2a405d19a8041aa386a9bde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1 2023-02-08 02:57:34,763 DEBUG [StoreOpener-1fe7fcbdd2a405d19a8041aa386a9bde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1 2023-02-08 02:57:34,764 INFO [StoreOpener-1fe7fcbdd2a405d19a8041aa386a9bde-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1fe7fcbdd2a405d19a8041aa386a9bde columnFamilyName family1 2023-02-08 02:57:34,765 INFO [StoreOpener-1fe7fcbdd2a405d19a8041aa386a9bde-1] regionserver.HStore(310): Store=1fe7fcbdd2a405d19a8041aa386a9bde/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:57:34,765 INFO [StoreOpener-1fe7fcbdd2a405d19a8041aa386a9bde-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1fe7fcbdd2a405d19a8041aa386a9bde 2023-02-08 02:57:34,766 DEBUG [StoreOpener-1fe7fcbdd2a405d19a8041aa386a9bde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2 2023-02-08 02:57:34,766 DEBUG [StoreOpener-1fe7fcbdd2a405d19a8041aa386a9bde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2 2023-02-08 02:57:34,767 INFO [StoreOpener-1fe7fcbdd2a405d19a8041aa386a9bde-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1fe7fcbdd2a405d19a8041aa386a9bde columnFamilyName family2 2023-02-08 02:57:34,768 INFO [StoreOpener-1fe7fcbdd2a405d19a8041aa386a9bde-1] regionserver.HStore(310): Store=1fe7fcbdd2a405d19a8041aa386a9bde/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:57:34,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde 2023-02-08 02:57:34,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde 2023-02-08 02:57:34,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 02:57:34,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 1fe7fcbdd2a405d19a8041aa386a9bde 2023-02-08 02:57:34,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:57:34,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 1fe7fcbdd2a405d19a8041aa386a9bde; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69404591, jitterRate=0.0342089980840683}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 02:57:34,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 1fe7fcbdd2a405d19a8041aa386a9bde: Running coprocessor pre-open hook at 1675825054759Writing region info on filesystem at 1675825054759Initializing all the Stores at 1675825054761 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825054761Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825054761Cleaning up temporary data from old regions at 1675825054769 (+8 ms)Cleaning up detritus from prior splits at 1675825054770 (+1 ms)Running coprocessor post-open hooks at 1675825054774 (+4 ms)Region opened successfully at 1675825054774 2023-02-08 02:57:34,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde., pid=109, masterSystemTime=1675825054748 2023-02-08 02:57:34,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:57:34,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:57:34,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:57:34,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 78af5cf8f1dc144d3a534e1053ebf08a, NAME => 'ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a.', STARTKEY => '', ENDKEY => '1'} 2023-02-08 02:57:34,776 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=1fe7fcbdd2a405d19a8041aa386a9bde, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:34,776 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675825054775"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675825054775"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675825054775"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675825054775"}]},"ts":"1675825054775"} 2023-02-08 02:57:34,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 78af5cf8f1dc144d3a534e1053ebf08a 2023-02-08 02:57:34,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:57:34,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 78af5cf8f1dc144d3a534e1053ebf08a 2023-02-08 02:57:34,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 78af5cf8f1dc144d3a534e1053ebf08a 2023-02-08 02:57:34,777 INFO [StoreOpener-78af5cf8f1dc144d3a534e1053ebf08a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 78af5cf8f1dc144d3a534e1053ebf08a 2023-02-08 02:57:34,778 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=108 2023-02-08 02:57:34,778 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=108, state=SUCCESS; OpenRegionProcedure 1fe7fcbdd2a405d19a8041aa386a9bde, server=jenkins-hbase12.apache.org,44577,1675824910652 in 180 msec 2023-02-08 02:57:34,778 DEBUG [StoreOpener-78af5cf8f1dc144d3a534e1053ebf08a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1 2023-02-08 02:57:34,778 DEBUG [StoreOpener-78af5cf8f1dc144d3a534e1053ebf08a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1 2023-02-08 02:57:34,778 INFO [StoreOpener-78af5cf8f1dc144d3a534e1053ebf08a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78af5cf8f1dc144d3a534e1053ebf08a columnFamilyName family1 2023-02-08 02:57:34,778 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1fe7fcbdd2a405d19a8041aa386a9bde, ASSIGN in 347 msec 2023-02-08 02:57:34,779 INFO [StoreOpener-78af5cf8f1dc144d3a534e1053ebf08a-1] regionserver.HStore(310): Store=78af5cf8f1dc144d3a534e1053ebf08a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:57:34,779 INFO [StoreOpener-78af5cf8f1dc144d3a534e1053ebf08a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 78af5cf8f1dc144d3a534e1053ebf08a 2023-02-08 02:57:34,780 DEBUG [StoreOpener-78af5cf8f1dc144d3a534e1053ebf08a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2 2023-02-08 02:57:34,780 DEBUG [StoreOpener-78af5cf8f1dc144d3a534e1053ebf08a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2 2023-02-08 02:57:34,780 INFO [StoreOpener-78af5cf8f1dc144d3a534e1053ebf08a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78af5cf8f1dc144d3a534e1053ebf08a columnFamilyName family2 2023-02-08 02:57:34,781 INFO [StoreOpener-78af5cf8f1dc144d3a534e1053ebf08a-1] regionserver.HStore(310): Store=78af5cf8f1dc144d3a534e1053ebf08a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:57:34,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a 2023-02-08 02:57:34,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a 2023-02-08 02:57:34,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 02:57:34,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 78af5cf8f1dc144d3a534e1053ebf08a 2023-02-08 02:57:34,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:57:34,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 78af5cf8f1dc144d3a534e1053ebf08a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67931617, jitterRate=0.01225997507572174}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 02:57:34,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 78af5cf8f1dc144d3a534e1053ebf08a: Running coprocessor pre-open hook at 1675825054776Writing region info on filesystem at 1675825054776Initializing all the Stores at 1675825054777 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825054777Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825054777Cleaning up temporary data from old regions at 1675825054782 (+5 ms)Cleaning up detritus from prior splits at 1675825054783 (+1 ms)Running coprocessor post-open hooks at 1675825054786 (+3 ms)Region opened successfully at 1675825054786 2023-02-08 02:57:34,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a., pid=110, masterSystemTime=1675825054748 2023-02-08 02:57:34,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:57:34,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:57:34,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:57:34,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 56fee2d3c0105f54ac56ad88bfb2a274, NAME => 'ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274.', STARTKEY => '1', ENDKEY => '2'} 2023-02-08 02:57:34,787 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=78af5cf8f1dc144d3a534e1053ebf08a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:34,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 56fee2d3c0105f54ac56ad88bfb2a274 2023-02-08 02:57:34,787 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675825054787"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675825054787"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675825054787"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675825054787"}]},"ts":"1675825054787"} 2023-02-08 02:57:34,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:57:34,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 56fee2d3c0105f54ac56ad88bfb2a274 2023-02-08 02:57:34,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 56fee2d3c0105f54ac56ad88bfb2a274 2023-02-08 02:57:34,789 INFO [StoreOpener-56fee2d3c0105f54ac56ad88bfb2a274-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 56fee2d3c0105f54ac56ad88bfb2a274 2023-02-08 02:57:34,789 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=106 2023-02-08 02:57:34,789 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure 78af5cf8f1dc144d3a534e1053ebf08a, server=jenkins-hbase12.apache.org,44577,1675824910652 in 191 msec 2023-02-08 02:57:34,790 DEBUG [StoreOpener-56fee2d3c0105f54ac56ad88bfb2a274-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1 2023-02-08 02:57:34,790 DEBUG [StoreOpener-56fee2d3c0105f54ac56ad88bfb2a274-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1 2023-02-08 02:57:34,790 INFO [StoreOpener-56fee2d3c0105f54ac56ad88bfb2a274-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 56fee2d3c0105f54ac56ad88bfb2a274 columnFamilyName family1 2023-02-08 02:57:34,790 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=78af5cf8f1dc144d3a534e1053ebf08a, ASSIGN in 358 msec 2023-02-08 02:57:34,791 INFO [StoreOpener-56fee2d3c0105f54ac56ad88bfb2a274-1] regionserver.HStore(310): Store=56fee2d3c0105f54ac56ad88bfb2a274/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:57:34,791 INFO [StoreOpener-56fee2d3c0105f54ac56ad88bfb2a274-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 56fee2d3c0105f54ac56ad88bfb2a274 2023-02-08 02:57:34,792 DEBUG [StoreOpener-56fee2d3c0105f54ac56ad88bfb2a274-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2 2023-02-08 02:57:34,792 DEBUG [StoreOpener-56fee2d3c0105f54ac56ad88bfb2a274-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2 2023-02-08 02:57:34,792 INFO [StoreOpener-56fee2d3c0105f54ac56ad88bfb2a274-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 56fee2d3c0105f54ac56ad88bfb2a274 columnFamilyName family2 2023-02-08 02:57:34,793 INFO [StoreOpener-56fee2d3c0105f54ac56ad88bfb2a274-1] regionserver.HStore(310): Store=56fee2d3c0105f54ac56ad88bfb2a274/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:57:34,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274 2023-02-08 02:57:34,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274 2023-02-08 02:57:34,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 02:57:34,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 56fee2d3c0105f54ac56ad88bfb2a274 2023-02-08 02:57:34,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:57:34,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 56fee2d3c0105f54ac56ad88bfb2a274; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61006621, jitterRate=-0.0909305065870285}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 02:57:34,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 56fee2d3c0105f54ac56ad88bfb2a274: Running coprocessor pre-open hook at 1675825054788Writing region info on filesystem at 1675825054788Initializing all the Stores at 1675825054788Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825054788Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825054788Cleaning up temporary data from old regions at 1675825054794 (+6 ms)Cleaning up detritus from prior splits at 1675825054794Running coprocessor post-open hooks at 1675825054797 (+3 ms)Region opened successfully at 1675825054797 2023-02-08 02:57:34,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274., pid=111, masterSystemTime=1675825054748 2023-02-08 02:57:34,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:57:34,799 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:57:34,799 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=56fee2d3c0105f54ac56ad88bfb2a274, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:34,799 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1675825054799"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675825054799"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675825054799"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675825054799"}]},"ts":"1675825054799"} 2023-02-08 02:57:34,801 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=107 2023-02-08 02:57:34,801 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure 56fee2d3c0105f54ac56ad88bfb2a274, server=jenkins-hbase12.apache.org,44577,1675824910652 in 203 msec 2023-02-08 02:57:34,802 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-02-08 02:57:34,802 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=56fee2d3c0105f54ac56ad88bfb2a274, ASSIGN in 370 msec 2023-02-08 02:57:34,803 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 02:57:34,803 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675825054803"}]},"ts":"1675825054803"} 2023-02-08 02:57:34,804 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-02-08 02:57:34,853 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 02:57:34,857 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.3290 sec 2023-02-08 02:57:35,014 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/.tmp/family1/592cf1bc38f84fc6a90a7b3f239e89a3 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/592cf1bc38f84fc6a90a7b3f239e89a3 2023-02-08 02:57:35,020 INFO [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 12373e98d6fb3636c0d02a5815aad09c/family1 of 12373e98d6fb3636c0d02a5815aad09c into 592cf1bc38f84fc6a90a7b3f239e89a3(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:57:35,021 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 12373e98d6fb3636c0d02a5815aad09c: 2023-02-08 02:57:35,021 INFO [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1675825053355; duration=1sec 2023-02-08 02:57:35,021 DEBUG [RS:0;jenkins-hbase12:44577-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:57:35,115 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-05d45fa5b0704cd699922167246d4cd0, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-4408b3d2330549328be2f2cd48bba925, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-bc906f7bf326433f8c5843320d441c07, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-3c3fa3a23f91414183577cd2042f12eb, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/fbd6bbd79a8d4ec385b0a337286a3491_SeqId_34_] to archive 2023-02-08 02:57:35,116 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:35,119 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-05d45fa5b0704cd699922167246d4cd0 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-05d45fa5b0704cd699922167246d4cd0 2023-02-08 02:57:35,121 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-4408b3d2330549328be2f2cd48bba925 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-4408b3d2330549328be2f2cd48bba925 2023-02-08 02:57:35,124 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-bc906f7bf326433f8c5843320d441c07 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-bc906f7bf326433f8c5843320d441c07 2023-02-08 02:57:35,126 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-3c3fa3a23f91414183577cd2042f12eb to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/testCompactionWithHFileLink=12373e98d6fb3636c0d02a5815aad09c-3c3fa3a23f91414183577cd2042f12eb 2023-02-08 02:57:35,128 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/fbd6bbd79a8d4ec385b0a337286a3491_SeqId_34_ to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/family1/fbd6bbd79a8d4ec385b0a337286a3491_SeqId_34_ 2023-02-08 02:57:35,637 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:35,638 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:35,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-08 02:57:35,640 INFO [Listener at localhost.localdomain/44017] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-02-08 02:57:35,652 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:35,653 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:35,654 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:35,655 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:35,655 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:35,655 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:57:35,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-08 02:57:35,657 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-08 02:57:35,657 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:35,657 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-08 02:57:35,657 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-08 02:57:35,657 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:35,657 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:35,683 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:35,683 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:35,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:35,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:35,684 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:35,684 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:57:35,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:35,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:35,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:57:35,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:35,685 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-08 02:57:35,685 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-08 02:57:35,685 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-08 02:57:35,685 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:35,685 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-08 02:57:35,685 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:57:35,686 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:57:35,686 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. started... 2023-02-08 02:57:35,686 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 02:57:35,688 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:57:35,686 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. started... 2023-02-08 02:57:35,688 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 56fee2d3c0105f54ac56ad88bfb2a274 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-08 02:57:35,686 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:57:35,688 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1fe7fcbdd2a405d19a8041aa386a9bde 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-08 02:57:35,688 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. started... 2023-02-08 02:57:35,688 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 78af5cf8f1dc144d3a534e1053ebf08a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-08 02:57:36,118 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208e0c214c77de3426ab8c9fe8ee85630d4 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230208e0c214c77de3426ab8c9fe8ee85630d4 2023-02-08 02:57:36,119 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208f7ef871004a44422b20fb42a1b458f61 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230208f7ef871004a44422b20fb42a1b458f61 2023-02-08 02:57:36,120 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208840db5092f0046bebd4b070bc6bbe5be to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230208840db5092f0046bebd4b070bc6bbe5be 2023-02-08 02:57:36,130 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp/family1/b89a3754e06b47a4a003aba33ec3fd2c 2023-02-08 02:57:36,528 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp/family1/decd83b4c8f94087ba68c087c3fd1762 2023-02-08 02:57:36,531 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp/family1/d941718e89f6470d9e129b62dfa798c6 2023-02-08 02:57:36,542 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020888038254dbdf4d5c855a74f7a199c473 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023020888038254dbdf4d5c855a74f7a199c473 2023-02-08 02:57:36,947 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp/family2/b43390a38cfa43f288062298e68e4a31 2023-02-08 02:57:36,949 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020864224097d4e54c599c5b19a4c44c4745 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023020864224097d4e54c599c5b19a4c44c4745 2023-02-08 02:57:36,949 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302080dce56ae4cd7424bafd0affccdfec572 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302080dce56ae4cd7424bafd0affccdfec572 2023-02-08 02:57:36,951 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp/family1/b89a3754e06b47a4a003aba33ec3fd2c as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/b89a3754e06b47a4a003aba33ec3fd2c 2023-02-08 02:57:36,954 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/b89a3754e06b47a4a003aba33ec3fd2c, entries=4, sequenceid=5, filesize=5.4 K 2023-02-08 02:57:36,955 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp/family2/b43390a38cfa43f288062298e68e4a31 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/b43390a38cfa43f288062298e68e4a31 2023-02-08 02:57:36,958 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/b43390a38cfa43f288062298e68e4a31, entries=2, sequenceid=5, filesize=5.1 K 2023-02-08 02:57:36,959 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 78af5cf8f1dc144d3a534e1053ebf08a in 1271ms, sequenceid=5, compaction requested=false 2023-02-08 02:57:36,959 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-02-08 02:57:36,959 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 78af5cf8f1dc144d3a534e1053ebf08a: 2023-02-08 02:57:36,959 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:57:36,959 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 02:57:37,038 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 02:57:37,361 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp/family2/d76d7fb6bcfa4e12b3e99b1794508422 2023-02-08 02:57:37,367 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp/family2/432a3facb6cd4f649692d95a95ee8713 2023-02-08 02:57:37,373 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp/family1/decd83b4c8f94087ba68c087c3fd1762 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/decd83b4c8f94087ba68c087c3fd1762 2023-02-08 02:57:37,375 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp/family1/d941718e89f6470d9e129b62dfa798c6 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/d941718e89f6470d9e129b62dfa798c6 2023-02-08 02:57:37,377 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/decd83b4c8f94087ba68c087c3fd1762, entries=4, sequenceid=5, filesize=5.4 K 2023-02-08 02:57:37,378 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp/family2/d76d7fb6bcfa4e12b3e99b1794508422 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/d76d7fb6bcfa4e12b3e99b1794508422 2023-02-08 02:57:37,380 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/d941718e89f6470d9e129b62dfa798c6, entries=4, sequenceid=5, filesize=5.4 K 2023-02-08 02:57:37,381 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp/family2/432a3facb6cd4f649692d95a95ee8713 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/432a3facb6cd4f649692d95a95ee8713 2023-02-08 02:57:37,382 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/d76d7fb6bcfa4e12b3e99b1794508422, entries=2, sequenceid=5, filesize=5.1 K 2023-02-08 02:57:37,383 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 56fee2d3c0105f54ac56ad88bfb2a274 in 1695ms, sequenceid=5, compaction requested=false 2023-02-08 02:57:37,383 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 56fee2d3c0105f54ac56ad88bfb2a274: 2023-02-08 02:57:37,383 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:57:37,383 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 02:57:37,389 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/432a3facb6cd4f649692d95a95ee8713, entries=2, sequenceid=5, filesize=5.1 K 2023-02-08 02:57:37,390 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 1fe7fcbdd2a405d19a8041aa386a9bde in 1702ms, sequenceid=5, compaction requested=false 2023-02-08 02:57:37,390 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1fe7fcbdd2a405d19a8041aa386a9bde: 2023-02-08 02:57:37,390 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:57:37,390 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 02:57:37,390 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 02:57:37,390 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:37,390 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-08 02:57:37,390 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-08 02:57:37,441 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:37,441 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:37,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:37,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:37,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:37,441 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:37,441 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:57:37,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:37,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:37,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:37,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:37,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:37,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-08 02:57:37,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7821b10e[Count = 0] remaining members to acquire global barrier 2023-02-08 02:57:37,444 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-08 02:57:37,444 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:37,451 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:37,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:37,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:37,451 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-08 02:57:37,451 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-08 02:57:37,451 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:57:37,452 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:37,452 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:57:37,462 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-08 02:57:37,462 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:37,462 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:37,462 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-08 02:57:37,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:37,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:37,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:37,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:37,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:37,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:37,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:37,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:37,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:37,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:37,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:57:37,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-08 02:57:37,467 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-08 02:57:37,467 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:57:37,467 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:57:37,467 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-08 02:57:37,467 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:57:37,472 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:37,472 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:37,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:37,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:37,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:37,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:37,472 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:37,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:37,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:37,474 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:37,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:37,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:37,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:37,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:37,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:37,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:37,476 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:37,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:37,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:37,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:37,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:37,483 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:37,483 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:37,483 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:37,483 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:37,483 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-08 02:57:37,483 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:57:37,483 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:37,483 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:37,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:37,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:37,483 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:37,483 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-08 02:57:37,483 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-08 02:57:37,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:37,483 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:37,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:37,484 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:57:37,484 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:37,484 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:37,584 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:57:37,584 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:37,585 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:37,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:57:37,589 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:37,589 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:37,590 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:37,594 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:37,594 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:37,595 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:57:37,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-08 02:57:37,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-08 02:57:37,598 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-08 02:57:37,598 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:37,598 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-08 02:57:37,598 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-08 02:57:37,599 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:37,599 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:37,609 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:37,609 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:37,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:37,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:37,610 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:37,610 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:57:37,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:37,612 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:37,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:57:37,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:37,613 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-08 02:57:37,613 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-08 02:57:37,614 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-08 02:57:37,614 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-08 02:57:37,614 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:37,614 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-08 02:57:37,614 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:57:37,615 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. started... 2023-02-08 02:57:37,615 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:57:37,615 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1fe7fcbdd2a405d19a8041aa386a9bde 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-08 02:57:37,615 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:57:37,615 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. started... 2023-02-08 02:57:37,615 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 02:57:37,615 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 78af5cf8f1dc144d3a534e1053ebf08a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-08 02:57:37,615 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:57:37,615 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. started... 2023-02-08 02:57:37,616 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 56fee2d3c0105f54ac56ad88bfb2a274 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-08 02:57:37,806 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 02:57:37,806 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x236b9d91 to 127.0.0.1:49602 2023-02-08 02:57:37,806 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:57:37,806 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 02:57:37,806 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21466a4c to 127.0.0.1:49602 2023-02-08 02:57:37,807 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:57:38,037 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208ca9ed374b041443f9f15540eed8cb0ed to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230208ca9ed374b041443f9f15540eed8cb0ed 2023-02-08 02:57:38,038 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208a40935186ed148a9a2eb799bb543dcb3 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230208a40935186ed148a9a2eb799bb543dcb3 2023-02-08 02:57:38,038 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208b9645795b0014c11b2249427f382e20f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230208b9645795b0014c11b2249427f382e20f 2023-02-08 02:57:38,443 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp/family1/a33b54c5b3aa4d17ad2e20fe8845a6b2 2023-02-08 02:57:38,446 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp/family1/00be104fcbba4798a178c5b0b5c7d3ad 2023-02-08 02:57:38,446 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp/family1/cbfb89da5dd44dff9ee70942d3ae4f9e 2023-02-08 02:57:38,872 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020803e57ee742c2442ba9f8c3c220c0cba7 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023020803e57ee742c2442ba9f8c3c220c0cba7 2023-02-08 02:57:38,872 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020877b6ecdf148b4bb291b9798a9b835569 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023020877b6ecdf148b4bb291b9798a9b835569 2023-02-08 02:57:38,874 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208195ac1e538fb43a89cd492c5a418b9fc to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230208195ac1e538fb43a89cd492c5a418b9fc 2023-02-08 02:57:39,278 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp/family2/a2c7a4baee1a4f878b09127c826c807f 2023-02-08 02:57:39,283 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp/family2/bcce0380e90e462a8b0ee85b8ba73f0f 2023-02-08 02:57:39,285 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp/family2/49f7f7370ea847b185d5a78a9afa7230 2023-02-08 02:57:39,287 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp/family1/cbfb89da5dd44dff9ee70942d3ae4f9e as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/cbfb89da5dd44dff9ee70942d3ae4f9e 2023-02-08 02:57:39,290 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp/family1/a33b54c5b3aa4d17ad2e20fe8845a6b2 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/a33b54c5b3aa4d17ad2e20fe8845a6b2 2023-02-08 02:57:39,291 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp/family1/00be104fcbba4798a178c5b0b5c7d3ad as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/00be104fcbba4798a178c5b0b5c7d3ad 2023-02-08 02:57:39,292 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/cbfb89da5dd44dff9ee70942d3ae4f9e, entries=4, sequenceid=9, filesize=5.4 K 2023-02-08 02:57:39,292 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp/family2/a2c7a4baee1a4f878b09127c826c807f as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/a2c7a4baee1a4f878b09127c826c807f 2023-02-08 02:57:39,294 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/a33b54c5b3aa4d17ad2e20fe8845a6b2, entries=4, sequenceid=9, filesize=5.4 K 2023-02-08 02:57:39,294 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/00be104fcbba4798a178c5b0b5c7d3ad, entries=4, sequenceid=9, filesize=5.4 K 2023-02-08 02:57:39,294 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp/family2/bcce0380e90e462a8b0ee85b8ba73f0f as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/bcce0380e90e462a8b0ee85b8ba73f0f 2023-02-08 02:57:39,295 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp/family2/49f7f7370ea847b185d5a78a9afa7230 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/49f7f7370ea847b185d5a78a9afa7230 2023-02-08 02:57:39,296 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/a2c7a4baee1a4f878b09127c826c807f, entries=2, sequenceid=9, filesize=5.1 K 2023-02-08 02:57:39,297 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1fe7fcbdd2a405d19a8041aa386a9bde in 1682ms, sequenceid=9, compaction requested=false 2023-02-08 02:57:39,297 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1fe7fcbdd2a405d19a8041aa386a9bde: 2023-02-08 02:57:39,297 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:57:39,297 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 02:57:39,299 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/bcce0380e90e462a8b0ee85b8ba73f0f, entries=2, sequenceid=9, filesize=5.1 K 2023-02-08 02:57:39,299 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/49f7f7370ea847b185d5a78a9afa7230, entries=2, sequenceid=9, filesize=5.1 K 2023-02-08 02:57:39,299 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 78af5cf8f1dc144d3a534e1053ebf08a in 1684ms, sequenceid=9, compaction requested=false 2023-02-08 02:57:39,299 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 56fee2d3c0105f54ac56ad88bfb2a274 in 1683ms, sequenceid=9, compaction requested=false 2023-02-08 02:57:39,299 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 78af5cf8f1dc144d3a534e1053ebf08a: 2023-02-08 02:57:39,299 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 56fee2d3c0105f54ac56ad88bfb2a274: 2023-02-08 02:57:39,299 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:57:39,300 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:57:39,300 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 02:57:39,300 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 02:57:39,300 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 02:57:39,300 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:39,300 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-08 02:57:39,300 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-08 02:57:39,394 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:39,394 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:39,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:39,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:39,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:39,395 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:39,395 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:57:39,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:39,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:39,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:39,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:39,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:39,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-08 02:57:39,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4324803c[Count = 0] remaining members to acquire global barrier 2023-02-08 02:57:39,398 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-08 02:57:39,398 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:39,419 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:39,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:39,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:39,419 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-08 02:57:39,419 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-08 02:57:39,419 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:57:39,419 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:39,420 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:57:39,430 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-08 02:57:39,430 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:39,431 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:39,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:39,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:39,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:39,431 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-08 02:57:39,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:39,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:39,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:39,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:39,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:39,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:39,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:39,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:57:39,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-08 02:57:39,437 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-08 02:57:39,438 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:57:39,438 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:57:39,438 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-08 02:57:39,438 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:57:39,451 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:39,451 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:39,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:39,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:39,451 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:39,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:39,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:39,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:39,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:39,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:39,453 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:39,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:39,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:39,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:39,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:39,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:39,456 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:39,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:39,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:39,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:39,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:39,471 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:39,472 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:39,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:39,471 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:39,472 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:39,472 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:39,472 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-08 02:57:39,472 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:57:39,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:39,472 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:39,472 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-08 02:57:39,472 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:39,472 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-08 02:57:39,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:39,472 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:57:39,472 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:39,473 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:39,473 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:39,573 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:57:39,573 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:39,573 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:39,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:57:39,578 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:39,579 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:39,579 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:39,584 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:39,584 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:39,585 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:57:39,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-08 02:57:39,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-08 02:57:39,587 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-08 02:57:39,587 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:39,587 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-08 02:57:39,587 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-08 02:57:39,587 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:39,587 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:39,599 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:39,599 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:39,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:39,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:39,599 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:39,599 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:57:39,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:39,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:39,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:57:39,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:39,600 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-08 02:57:39,600 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-08 02:57:39,600 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-08 02:57:39,600 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-08 02:57:39,601 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:39,601 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-08 02:57:39,601 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:57:39,601 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:57:39,601 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. started... 2023-02-08 02:57:39,601 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. started... 2023-02-08 02:57:39,601 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 02:57:39,601 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:57:39,601 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 56fee2d3c0105f54ac56ad88bfb2a274 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-08 02:57:39,601 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:57:39,601 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. started... 2023-02-08 02:57:39,601 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1fe7fcbdd2a405d19a8041aa386a9bde 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-08 02:57:39,601 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 78af5cf8f1dc144d3a534e1053ebf08a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-08 02:57:40,025 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020895c0d4157aad44ecbd166d2630d25e9d to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023020895c0d4157aad44ecbd166d2630d25e9d 2023-02-08 02:57:40,027 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020897bfd1f285b547e8b7ab1b273ad04add to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023020897bfd1f285b547e8b7ab1b273ad04add 2023-02-08 02:57:40,027 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302083716abf8e9d44c56a9db17b8af14733d to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302083716abf8e9d44c56a9db17b8af14733d 2023-02-08 02:57:40,031 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp/family1/16653a7113de47a3982865b96a272dce 2023-02-08 02:57:40,432 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp/family1/3fa1196f0fb047d18b472355bbafeaed 2023-02-08 02:57:40,432 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp/family1/4ac129cc47b141638550227d138a1f5c 2023-02-08 02:57:40,444 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208689cf9bc51c14ade9774475746e5c181 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230208689cf9bc51c14ade9774475746e5c181 2023-02-08 02:57:40,849 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp/family2/1aa57e4bf5124fb0904a5b751e173c44 2023-02-08 02:57:40,855 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208fa0e249864b6421fbb89339810c5a371 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230208fa0e249864b6421fbb89339810c5a371 2023-02-08 02:57:40,855 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020841f47a9f9ff247a4ba861137a92a389a to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023020841f47a9f9ff247a4ba861137a92a389a 2023-02-08 02:57:40,856 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp/family1/16653a7113de47a3982865b96a272dce as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/16653a7113de47a3982865b96a272dce 2023-02-08 02:57:40,861 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/16653a7113de47a3982865b96a272dce, entries=4, sequenceid=13, filesize=5.4 K 2023-02-08 02:57:40,861 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp/family2/ccd7ab06725a48d1974991d6d1671e6e 2023-02-08 02:57:40,862 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp/family2/1aa57e4bf5124fb0904a5b751e173c44 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/1aa57e4bf5124fb0904a5b751e173c44 2023-02-08 02:57:40,866 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp/family1/3fa1196f0fb047d18b472355bbafeaed as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/3fa1196f0fb047d18b472355bbafeaed 2023-02-08 02:57:40,866 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/1aa57e4bf5124fb0904a5b751e173c44, entries=2, sequenceid=13, filesize=5.1 K 2023-02-08 02:57:40,867 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 1fe7fcbdd2a405d19a8041aa386a9bde in 1266ms, sequenceid=13, compaction requested=true 2023-02-08 02:57:40,867 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1fe7fcbdd2a405d19a8041aa386a9bde: 2023-02-08 02:57:40,867 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:57:40,867 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 02:57:40,869 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/3fa1196f0fb047d18b472355bbafeaed, entries=4, sequenceid=13, filesize=5.4 K 2023-02-08 02:57:40,870 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp/family2/ccd7ab06725a48d1974991d6d1671e6e as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/ccd7ab06725a48d1974991d6d1671e6e 2023-02-08 02:57:40,875 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/ccd7ab06725a48d1974991d6d1671e6e, entries=2, sequenceid=13, filesize=5.1 K 2023-02-08 02:57:40,875 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 56fee2d3c0105f54ac56ad88bfb2a274 in 1274ms, sequenceid=13, compaction requested=true 2023-02-08 02:57:40,875 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 56fee2d3c0105f54ac56ad88bfb2a274: 2023-02-08 02:57:40,876 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:57:40,876 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 02:57:41,262 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp/family2/08942173876a48e3884392af6442a2f6 2023-02-08 02:57:41,270 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp/family1/4ac129cc47b141638550227d138a1f5c as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/4ac129cc47b141638550227d138a1f5c 2023-02-08 02:57:41,275 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/4ac129cc47b141638550227d138a1f5c, entries=4, sequenceid=13, filesize=5.4 K 2023-02-08 02:57:41,276 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp/family2/08942173876a48e3884392af6442a2f6 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/08942173876a48e3884392af6442a2f6 2023-02-08 02:57:41,281 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/08942173876a48e3884392af6442a2f6, entries=2, sequenceid=13, filesize=5.1 K 2023-02-08 02:57:41,282 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 78af5cf8f1dc144d3a534e1053ebf08a in 1681ms, sequenceid=13, compaction requested=true 2023-02-08 02:57:41,282 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 78af5cf8f1dc144d3a534e1053ebf08a: 2023-02-08 02:57:41,282 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:57:41,282 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 02:57:41,283 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 02:57:41,283 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:41,283 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-08 02:57:41,283 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-08 02:57:41,336 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:41,336 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:41,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:41,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:41,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:41,337 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:41,337 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:57:41,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:41,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:41,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:41,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:41,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:41,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-08 02:57:41,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ec22887[Count = 0] remaining members to acquire global barrier 2023-02-08 02:57:41,343 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-08 02:57:41,343 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:41,357 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:41,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:41,357 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-08 02:57:41,357 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-08 02:57:41,357 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:57:41,357 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:41,358 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:57:41,367 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-08 02:57:41,367 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:41,367 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:41,367 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-08 02:57:41,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:41,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:41,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:41,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:41,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:41,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:41,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:41,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:41,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:41,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:57:41,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-08 02:57:41,377 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-08 02:57:41,377 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:57:41,377 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:57:41,377 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-08 02:57:41,377 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:57:41,388 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:41,388 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:41,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:41,388 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:41,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:41,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:41,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:41,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:41,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:41,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:41,390 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:41,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:41,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:41,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:41,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:41,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:41,392 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:41,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:41,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:41,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:41,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:41,399 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:41,399 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:41,399 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:41,399 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:41,399 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-08 02:57:41,399 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:57:41,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:41,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:41,399 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:41,399 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:41,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-08 02:57:41,399 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:41,399 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-08 02:57:41,399 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:41,400 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:57:41,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:41,400 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:41,400 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:41,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:41,500 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:57:41,500 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:41,501 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:41,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:57:41,506 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:41,506 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:41,507 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:57:41,511 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:41,512 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:41,512 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:57:41,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-08 02:57:41,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-08 02:57:41,515 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-08 02:57:41,515 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:41,515 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-08 02:57:41,515 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-08 02:57:41,516 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:41,516 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:41,525 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:41,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:41,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:41,525 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:41,526 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:41,526 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:57:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:41,527 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:41,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:57:41,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:41,528 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-08 02:57:41,528 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-08 02:57:41,529 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-08 02:57:41,529 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-08 02:57:41,529 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:41,529 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-08 02:57:41,529 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:57:41,529 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. started... 2023-02-08 02:57:41,529 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:57:41,530 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. started... 2023-02-08 02:57:41,529 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 02:57:41,530 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:57:41,530 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1fe7fcbdd2a405d19a8041aa386a9bde 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-08 02:57:41,530 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:57:41,530 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. started... 2023-02-08 02:57:41,530 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 56fee2d3c0105f54ac56ad88bfb2a274 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-08 02:57:41,530 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 78af5cf8f1dc144d3a534e1053ebf08a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-08 02:57:41,950 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302082c81e36497cb46528023d7d31ddd0b7b to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302082c81e36497cb46528023d7d31ddd0b7b 2023-02-08 02:57:41,950 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020836f9e98ba7074e718b7335c128a52695 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023020836f9e98ba7074e718b7335c128a52695 2023-02-08 02:57:41,951 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302088fe5245a482448b19851780ccb20e38a to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302088fe5245a482448b19851780ccb20e38a 2023-02-08 02:57:42,358 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp/family1/5dafdf96031c493a8741a866a22a421c 2023-02-08 02:57:42,358 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp/family1/47ab22cfa4764de59a5d27616175c8c4 2023-02-08 02:57:42,358 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp/family1/b3aa5e0b63e04a9dafd7d4065670f841 2023-02-08 02:57:42,384 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208a2e3fcf8a4ec46d3b5eb659e87229e90 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230208a2e3fcf8a4ec46d3b5eb659e87229e90 2023-02-08 02:57:42,789 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp/family2/e35acfd197124e34a1ac2654cc926bb0 2023-02-08 02:57:42,789 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020855c02fdfa94341749361a43b990dfb05 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023020855c02fdfa94341749361a43b990dfb05 2023-02-08 02:57:42,790 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208e408bd2cc3944b1d8acc9fa447335660 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230208e408bd2cc3944b1d8acc9fa447335660 2023-02-08 02:57:42,796 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp/family1/47ab22cfa4764de59a5d27616175c8c4 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/47ab22cfa4764de59a5d27616175c8c4 2023-02-08 02:57:42,801 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/47ab22cfa4764de59a5d27616175c8c4, entries=4, sequenceid=17, filesize=5.4 K 2023-02-08 02:57:42,802 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp/family2/e35acfd197124e34a1ac2654cc926bb0 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/e35acfd197124e34a1ac2654cc926bb0 2023-02-08 02:57:42,806 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/e35acfd197124e34a1ac2654cc926bb0, entries=2, sequenceid=17, filesize=5.1 K 2023-02-08 02:57:42,807 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 78af5cf8f1dc144d3a534e1053ebf08a in 1277ms, sequenceid=17, compaction requested=true 2023-02-08 02:57:42,807 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 78af5cf8f1dc144d3a534e1053ebf08a: 2023-02-08 02:57:42,807 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:57:42,807 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 02:57:43,198 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp/family2/2e367510b47849a29ee8da2c82f47528 2023-02-08 02:57:43,200 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp/family2/a97bb684411c426884cc7833388eb8cd 2023-02-08 02:57:43,208 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp/family1/b3aa5e0b63e04a9dafd7d4065670f841 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/b3aa5e0b63e04a9dafd7d4065670f841 2023-02-08 02:57:43,209 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp/family1/5dafdf96031c493a8741a866a22a421c as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/5dafdf96031c493a8741a866a22a421c 2023-02-08 02:57:43,213 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/5dafdf96031c493a8741a866a22a421c, entries=4, sequenceid=17, filesize=5.4 K 2023-02-08 02:57:43,213 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/b3aa5e0b63e04a9dafd7d4065670f841, entries=4, sequenceid=17, filesize=5.4 K 2023-02-08 02:57:43,214 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp/family2/a97bb684411c426884cc7833388eb8cd as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/a97bb684411c426884cc7833388eb8cd 2023-02-08 02:57:43,214 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp/family2/2e367510b47849a29ee8da2c82f47528 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/2e367510b47849a29ee8da2c82f47528 2023-02-08 02:57:43,218 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/a97bb684411c426884cc7833388eb8cd, entries=2, sequenceid=17, filesize=5.1 K 2023-02-08 02:57:43,218 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/2e367510b47849a29ee8da2c82f47528, entries=2, sequenceid=17, filesize=5.1 K 2023-02-08 02:57:43,218 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 56fee2d3c0105f54ac56ad88bfb2a274 in 1688ms, sequenceid=17, compaction requested=true 2023-02-08 02:57:43,218 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 1fe7fcbdd2a405d19a8041aa386a9bde in 1689ms, sequenceid=17, compaction requested=true 2023-02-08 02:57:43,218 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 56fee2d3c0105f54ac56ad88bfb2a274: 2023-02-08 02:57:43,218 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1fe7fcbdd2a405d19a8041aa386a9bde: 2023-02-08 02:57:43,218 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:57:43,218 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:57:43,219 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 02:57:43,219 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 02:57:43,219 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 02:57:43,219 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:43,219 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-08 02:57:43,219 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-08 02:57:43,272 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:43,272 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:43,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:43,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:43,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:43,273 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:43,273 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:57:43,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:43,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:43,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:43,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:43,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:43,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-08 02:57:43,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@606cc238[Count = 0] remaining members to acquire global barrier 2023-02-08 02:57:43,275 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-08 02:57:43,275 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:43,283 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:43,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:43,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:43,283 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-08 02:57:43,283 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-08 02:57:43,283 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:57:43,283 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:43,283 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:57:43,293 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-08 02:57:43,293 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:43,293 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-08 02:57:43,293 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:43,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:43,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:43,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:43,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:43,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:43,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:43,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:43,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:43,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:43,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:43,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:57:43,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-08 02:57:43,300 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-08 02:57:43,300 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:57:43,300 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:57:43,300 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-08 02:57:43,300 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:57:43,313 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:43,313 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:43,313 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:43,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:43,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:43,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:43,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:43,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:43,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:43,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:43,315 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:43,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:43,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:43,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:43,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:43,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:43,317 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:43,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:43,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:43,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:43,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:43,325 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:43,325 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:43,325 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:43,325 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:43,325 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-08 02:57:43,325 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:43,325 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-08 02:57:43,325 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:57:43,325 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:43,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:43,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:43,325 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:43,326 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-08 02:57:43,326 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:43,326 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:57:43,326 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:43,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:43,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:43,326 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:43,426 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:57:43,426 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:43,427 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:43,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:57:43,435 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 02:57:43,441 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 02:57:43,449 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 02:57:43,450 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 02:57:43,479 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:43,480 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:43,480 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:57:43,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-08 02:57:43,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-08 02:57:43,483 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-08 02:57:43,483 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:43,483 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-08 02:57:43,483 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-08 02:57:43,483 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:43,483 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:43,493 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:43,493 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:43,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:43,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:43,494 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:43,494 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:57:43,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:43,494 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:43,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:57:43,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:43,494 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-08 02:57:43,495 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-08 02:57:43,495 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-08 02:57:43,495 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-08 02:57:43,495 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:43,495 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-08 02:57:43,495 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:57:43,495 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. started... 2023-02-08 02:57:43,495 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 02:57:43,495 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:57:43,495 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:57:43,495 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. started... 2023-02-08 02:57:43,495 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1fe7fcbdd2a405d19a8041aa386a9bde 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-08 02:57:43,495 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:57:43,495 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 56fee2d3c0105f54ac56ad88bfb2a274 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-08 02:57:43,495 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. started... 2023-02-08 02:57:43,495 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 78af5cf8f1dc144d3a534e1053ebf08a 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-08 02:57:44,315 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp/family1/ef31ea2f46154616a0182b50f307bc22 2023-02-08 02:57:44,316 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp/family1/ab8d017c43b34107be1df181425c91ca 2023-02-08 02:57:44,318 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp/family1/73ab03fdd46d446da298bb1653ec0bec 2023-02-08 02:57:44,324 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ef31ea2f46154616a0182b50f307bc22 2023-02-08 02:57:44,324 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab8d017c43b34107be1df181425c91ca 2023-02-08 02:57:44,326 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 73ab03fdd46d446da298bb1653ec0bec 2023-02-08 02:57:45,185 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp/family2/4880b48f843d408fa863007fcc034b37 2023-02-08 02:57:45,185 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp/family2/02404379d8b349828dd513cf0242d3ff 2023-02-08 02:57:45,186 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp/family2/3a6b9a108e434163a9a7c8fe5782092d 2023-02-08 02:57:45,194 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 02404379d8b349828dd513cf0242d3ff 2023-02-08 02:57:45,194 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4880b48f843d408fa863007fcc034b37 2023-02-08 02:57:45,194 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3a6b9a108e434163a9a7c8fe5782092d 2023-02-08 02:57:45,195 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp/family1/ab8d017c43b34107be1df181425c91ca as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/ab8d017c43b34107be1df181425c91ca 2023-02-08 02:57:45,195 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp/family1/ef31ea2f46154616a0182b50f307bc22 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/ef31ea2f46154616a0182b50f307bc22 2023-02-08 02:57:45,195 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp/family1/73ab03fdd46d446da298bb1653ec0bec as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/73ab03fdd46d446da298bb1653ec0bec 2023-02-08 02:57:45,199 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ef31ea2f46154616a0182b50f307bc22 2023-02-08 02:57:45,199 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 73ab03fdd46d446da298bb1653ec0bec 2023-02-08 02:57:45,199 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab8d017c43b34107be1df181425c91ca 2023-02-08 02:57:45,199 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/73ab03fdd46d446da298bb1653ec0bec, entries=3, sequenceid=23, filesize=5.0 K 2023-02-08 02:57:45,199 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/ef31ea2f46154616a0182b50f307bc22, entries=3, sequenceid=23, filesize=5.0 K 2023-02-08 02:57:45,199 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/ab8d017c43b34107be1df181425c91ca, entries=3, sequenceid=23, filesize=5.0 K 2023-02-08 02:57:45,200 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp/family2/4880b48f843d408fa863007fcc034b37 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/4880b48f843d408fa863007fcc034b37 2023-02-08 02:57:45,200 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp/family2/3a6b9a108e434163a9a7c8fe5782092d as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/3a6b9a108e434163a9a7c8fe5782092d 2023-02-08 02:57:45,200 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp/family2/02404379d8b349828dd513cf0242d3ff as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/02404379d8b349828dd513cf0242d3ff 2023-02-08 02:57:45,204 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4880b48f843d408fa863007fcc034b37 2023-02-08 02:57:45,204 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 02404379d8b349828dd513cf0242d3ff 2023-02-08 02:57:45,204 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3a6b9a108e434163a9a7c8fe5782092d 2023-02-08 02:57:45,204 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/02404379d8b349828dd513cf0242d3ff, entries=1, sequenceid=23, filesize=5.0 K 2023-02-08 02:57:45,204 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/4880b48f843d408fa863007fcc034b37, entries=1, sequenceid=23, filesize=5.0 K 2023-02-08 02:57:45,204 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/3a6b9a108e434163a9a7c8fe5782092d, entries=1, sequenceid=23, filesize=5.0 K 2023-02-08 02:57:45,205 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 56fee2d3c0105f54ac56ad88bfb2a274 in 1710ms, sequenceid=23, compaction requested=true 2023-02-08 02:57:45,205 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 78af5cf8f1dc144d3a534e1053ebf08a in 1710ms, sequenceid=23, compaction requested=true 2023-02-08 02:57:45,205 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 56fee2d3c0105f54ac56ad88bfb2a274: 2023-02-08 02:57:45,205 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 78af5cf8f1dc144d3a534e1053ebf08a: 2023-02-08 02:57:45,205 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 1fe7fcbdd2a405d19a8041aa386a9bde in 1710ms, sequenceid=23, compaction requested=true 2023-02-08 02:57:45,205 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:57:45,205 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1fe7fcbdd2a405d19a8041aa386a9bde: 2023-02-08 02:57:45,205 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 02:57:45,205 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:57:45,205 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:57:45,205 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 02:57:45,205 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 02:57:45,205 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 02:57:45,205 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:45,205 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-08 02:57:45,205 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-08 02:57:45,251 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:45,251 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:45,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:45,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:45,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:45,252 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:45,252 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:57:45,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:45,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:45,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:45,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:45,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:45,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-08 02:57:45,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1530a6fa[Count = 0] remaining members to acquire global barrier 2023-02-08 02:57:45,257 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-08 02:57:45,257 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:45,290 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:45,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:45,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:45,290 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-08 02:57:45,290 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-08 02:57:45,290 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:57:45,290 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:45,291 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:57:45,304 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:45,304 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-08 02:57:45,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:45,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:45,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:45,304 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:45,304 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-08 02:57:45,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:45,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:45,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:45,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:45,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:45,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:45,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:45,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:57:45,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-08 02:57:45,310 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-08 02:57:45,311 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:57:45,311 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:57:45,311 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-08 02:57:45,311 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:57:45,324 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:45,324 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:45,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:45,324 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:45,324 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:45,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:45,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:45,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:45,325 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:45,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:45,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:45,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 02:57:45,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:45,335 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:45,335 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:45,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:45,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:45,335 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:45,335 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-08 02:57:45,336 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:57:45,335 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:45,335 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:45,336 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-08 02:57:45,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:45,336 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 02:57:45,336 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-08 02:57:45,336 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:45,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:45,336 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:45,336 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:57:45,336 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 02:57:45,336 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 02:57:45,436 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:57:45,436 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:45,437 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:45,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:57:45,438 DEBUG [Listener at localhost.localdomain/44017] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 02:57:45,439 DEBUG [Listener at localhost.localdomain/44017] regionserver.HStore(1912): 1fe7fcbdd2a405d19a8041aa386a9bde/family1 is initiating major compaction (all files) 2023-02-08 02:57:45,439 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 02:57:45,439 INFO [Listener at localhost.localdomain/44017] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 02:57:45,440 INFO [Listener at localhost.localdomain/44017] regionserver.HRegion(2258): Starting compaction of 1fe7fcbdd2a405d19a8041aa386a9bde/family1 in ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:57:45,440 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/d941718e89f6470d9e129b62dfa798c6, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/cbfb89da5dd44dff9ee70942d3ae4f9e, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/16653a7113de47a3982865b96a272dce, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/b3aa5e0b63e04a9dafd7d4065670f841, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/73ab03fdd46d446da298bb1653ec0bec] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp, totalSize=26.6 K 2023-02-08 02:57:45,441 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting d941718e89f6470d9e129b62dfa798c6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825055654 2023-02-08 02:57:45,442 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting cbfb89da5dd44dff9ee70942d3ae4f9e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825057590 2023-02-08 02:57:45,443 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 16653a7113de47a3982865b96a272dce, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825059579 2023-02-08 02:57:45,443 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting b3aa5e0b63e04a9dafd7d4065670f841, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825061507 2023-02-08 02:57:45,444 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 73ab03fdd46d446da298bb1653ec0bec, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 02:57:45,456 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareThroughputController(145): 1fe7fcbdd2a405d19a8041aa386a9bde#family1#compaction#150 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:57:45,868 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023020822420096adfd4f589767e15c10d10a21_del 2023-02-08 02:57:45,868 INFO [Listener at localhost.localdomain/44017] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020822420096adfd4f589767e15c10d10a21_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023020822420096adfd4f589767e15c10d10a21_del 2023-02-08 02:57:46,695 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 76988602be994fc3863d7dd9c31f4f7a 2023-02-08 02:57:46,697 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp/family1/76988602be994fc3863d7dd9c31f4f7a as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/76988602be994fc3863d7dd9c31f4f7a 2023-02-08 02:57:46,701 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 76988602be994fc3863d7dd9c31f4f7a 2023-02-08 02:57:46,703 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1fe7fcbdd2a405d19a8041aa386a9bde/family1 of 1fe7fcbdd2a405d19a8041aa386a9bde into 76988602be994fc3863d7dd9c31f4f7a(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:57:46,703 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegion(2288): Compaction status journal for 1fe7fcbdd2a405d19a8041aa386a9bde: 2023-02-08 02:57:46,703 DEBUG [Listener at localhost.localdomain/44017] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 02:57:46,703 DEBUG [Listener at localhost.localdomain/44017] regionserver.HStore(1912): 1fe7fcbdd2a405d19a8041aa386a9bde/family2 is initiating major compaction (all files) 2023-02-08 02:57:46,703 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 02:57:46,703 INFO [Listener at localhost.localdomain/44017] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 02:57:46,703 INFO [Listener at localhost.localdomain/44017] regionserver.HRegion(2258): Starting compaction of 1fe7fcbdd2a405d19a8041aa386a9bde/family2 in ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:57:46,703 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/432a3facb6cd4f649692d95a95ee8713, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/a2c7a4baee1a4f878b09127c826c807f, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/1aa57e4bf5124fb0904a5b751e173c44, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/2e367510b47849a29ee8da2c82f47528, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/3a6b9a108e434163a9a7c8fe5782092d] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp, totalSize=25.3 K 2023-02-08 02:57:46,704 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 432a3facb6cd4f649692d95a95ee8713, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825055654 2023-02-08 02:57:46,704 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting a2c7a4baee1a4f878b09127c826c807f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825057590 2023-02-08 02:57:46,705 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 1aa57e4bf5124fb0904a5b751e173c44, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825059579 2023-02-08 02:57:46,705 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 2e367510b47849a29ee8da2c82f47528, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825061507 2023-02-08 02:57:46,706 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 3a6b9a108e434163a9a7c8fe5782092d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 02:57:46,713 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/d941718e89f6470d9e129b62dfa798c6, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/cbfb89da5dd44dff9ee70942d3ae4f9e, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/16653a7113de47a3982865b96a272dce, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/b3aa5e0b63e04a9dafd7d4065670f841, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/73ab03fdd46d446da298bb1653ec0bec] to archive 2023-02-08 02:57:46,714 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:46,716 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/d941718e89f6470d9e129b62dfa798c6 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/d941718e89f6470d9e129b62dfa798c6 2023-02-08 02:57:46,718 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareThroughputController(145): 1fe7fcbdd2a405d19a8041aa386a9bde#family2#compaction#151 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:57:46,718 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/cbfb89da5dd44dff9ee70942d3ae4f9e to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/cbfb89da5dd44dff9ee70942d3ae4f9e 2023-02-08 02:57:46,720 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/16653a7113de47a3982865b96a272dce to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/16653a7113de47a3982865b96a272dce 2023-02-08 02:57:46,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/b3aa5e0b63e04a9dafd7d4065670f841 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/b3aa5e0b63e04a9dafd7d4065670f841 2023-02-08 02:57:46,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/73ab03fdd46d446da298bb1653ec0bec to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/73ab03fdd46d446da298bb1653ec0bec 2023-02-08 02:57:47,128 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023020868fbafa612224872b45a229e6d84e7c5_del 2023-02-08 02:57:47,128 INFO [Listener at localhost.localdomain/44017] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020868fbafa612224872b45a229e6d84e7c5_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023020868fbafa612224872b45a229e6d84e7c5_del 2023-02-08 02:57:47,550 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bd91b33704a24cf5b3ea267e48c36a6f 2023-02-08 02:57:47,551 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/.tmp/family2/bd91b33704a24cf5b3ea267e48c36a6f as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/bd91b33704a24cf5b3ea267e48c36a6f 2023-02-08 02:57:47,555 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bd91b33704a24cf5b3ea267e48c36a6f 2023-02-08 02:57:47,556 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1fe7fcbdd2a405d19a8041aa386a9bde/family2 of 1fe7fcbdd2a405d19a8041aa386a9bde into bd91b33704a24cf5b3ea267e48c36a6f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 02:57:47,556 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegion(2288): Compaction status journal for 1fe7fcbdd2a405d19a8041aa386a9bde: 2023-02-08 02:57:47,556 DEBUG [Listener at localhost.localdomain/44017] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 02:57:47,556 DEBUG [Listener at localhost.localdomain/44017] regionserver.HStore(1912): 56fee2d3c0105f54ac56ad88bfb2a274/family1 is initiating major compaction (all files) 2023-02-08 02:57:47,556 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 02:57:47,556 INFO [Listener at localhost.localdomain/44017] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 02:57:47,556 INFO [Listener at localhost.localdomain/44017] regionserver.HRegion(2258): Starting compaction of 56fee2d3c0105f54ac56ad88bfb2a274/family1 in ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:57:47,557 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/decd83b4c8f94087ba68c087c3fd1762, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/a33b54c5b3aa4d17ad2e20fe8845a6b2, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/3fa1196f0fb047d18b472355bbafeaed, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/5dafdf96031c493a8741a866a22a421c, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/ef31ea2f46154616a0182b50f307bc22] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp, totalSize=26.6 K 2023-02-08 02:57:47,557 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting decd83b4c8f94087ba68c087c3fd1762, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825055653 2023-02-08 02:57:47,558 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting a33b54c5b3aa4d17ad2e20fe8845a6b2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825057589 2023-02-08 02:57:47,558 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 3fa1196f0fb047d18b472355bbafeaed, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825059579 2023-02-08 02:57:47,559 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 5dafdf96031c493a8741a866a22a421c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825061506 2023-02-08 02:57:47,559 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting ef31ea2f46154616a0182b50f307bc22, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 02:57:47,571 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareThroughputController(145): 56fee2d3c0105f54ac56ad88bfb2a274#family1#compaction#152 average throughput is 0.41 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:57:47,613 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/432a3facb6cd4f649692d95a95ee8713, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/a2c7a4baee1a4f878b09127c826c807f, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/1aa57e4bf5124fb0904a5b751e173c44, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/2e367510b47849a29ee8da2c82f47528, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/3a6b9a108e434163a9a7c8fe5782092d] to archive 2023-02-08 02:57:47,614 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:47,615 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/432a3facb6cd4f649692d95a95ee8713 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/432a3facb6cd4f649692d95a95ee8713 2023-02-08 02:57:47,617 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/a2c7a4baee1a4f878b09127c826c807f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/a2c7a4baee1a4f878b09127c826c807f 2023-02-08 02:57:47,618 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/1aa57e4bf5124fb0904a5b751e173c44 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/1aa57e4bf5124fb0904a5b751e173c44 2023-02-08 02:57:47,619 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/2e367510b47849a29ee8da2c82f47528 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/2e367510b47849a29ee8da2c82f47528 2023-02-08 02:57:47,619 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/3a6b9a108e434163a9a7c8fe5782092d to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family2/3a6b9a108e434163a9a7c8fe5782092d 2023-02-08 02:57:47,988 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302085f1521661bf34b18a250ca27d5748759_del 2023-02-08 02:57:47,988 INFO [Listener at localhost.localdomain/44017] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302085f1521661bf34b18a250ca27d5748759_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302085f1521661bf34b18a250ca27d5748759_del 2023-02-08 02:57:48,819 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d782a7320bd44eebbc8abff52e4b3439 2023-02-08 02:57:48,820 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp/family1/d782a7320bd44eebbc8abff52e4b3439 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/d782a7320bd44eebbc8abff52e4b3439 2023-02-08 02:57:48,825 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d782a7320bd44eebbc8abff52e4b3439 2023-02-08 02:57:48,825 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 56fee2d3c0105f54ac56ad88bfb2a274/family1 of 56fee2d3c0105f54ac56ad88bfb2a274 into d782a7320bd44eebbc8abff52e4b3439(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:57:48,826 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegion(2288): Compaction status journal for 56fee2d3c0105f54ac56ad88bfb2a274: 2023-02-08 02:57:48,826 DEBUG [Listener at localhost.localdomain/44017] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 02:57:48,826 DEBUG [Listener at localhost.localdomain/44017] regionserver.HStore(1912): 56fee2d3c0105f54ac56ad88bfb2a274/family2 is initiating major compaction (all files) 2023-02-08 02:57:48,826 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 02:57:48,826 INFO [Listener at localhost.localdomain/44017] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 02:57:48,826 INFO [Listener at localhost.localdomain/44017] regionserver.HRegion(2258): Starting compaction of 56fee2d3c0105f54ac56ad88bfb2a274/family2 in ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:57:48,826 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/d76d7fb6bcfa4e12b3e99b1794508422, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/bcce0380e90e462a8b0ee85b8ba73f0f, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/ccd7ab06725a48d1974991d6d1671e6e, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/a97bb684411c426884cc7833388eb8cd, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/4880b48f843d408fa863007fcc034b37] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp, totalSize=25.3 K 2023-02-08 02:57:48,827 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting d76d7fb6bcfa4e12b3e99b1794508422, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825055653 2023-02-08 02:57:48,827 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting bcce0380e90e462a8b0ee85b8ba73f0f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825057589 2023-02-08 02:57:48,828 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting ccd7ab06725a48d1974991d6d1671e6e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825059579 2023-02-08 02:57:48,828 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting a97bb684411c426884cc7833388eb8cd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825061506 2023-02-08 02:57:48,828 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 4880b48f843d408fa863007fcc034b37, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 02:57:48,839 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareThroughputController(145): 56fee2d3c0105f54ac56ad88bfb2a274#family2#compaction#153 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:57:48,913 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/decd83b4c8f94087ba68c087c3fd1762, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/a33b54c5b3aa4d17ad2e20fe8845a6b2, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/3fa1196f0fb047d18b472355bbafeaed, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/5dafdf96031c493a8741a866a22a421c, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/ef31ea2f46154616a0182b50f307bc22] to archive 2023-02-08 02:57:48,914 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:48,917 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/decd83b4c8f94087ba68c087c3fd1762 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/decd83b4c8f94087ba68c087c3fd1762 2023-02-08 02:57:48,920 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/a33b54c5b3aa4d17ad2e20fe8845a6b2 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/a33b54c5b3aa4d17ad2e20fe8845a6b2 2023-02-08 02:57:48,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/3fa1196f0fb047d18b472355bbafeaed to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/3fa1196f0fb047d18b472355bbafeaed 2023-02-08 02:57:48,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/5dafdf96031c493a8741a866a22a421c to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/5dafdf96031c493a8741a866a22a421c 2023-02-08 02:57:48,926 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/ef31ea2f46154616a0182b50f307bc22 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/ef31ea2f46154616a0182b50f307bc22 2023-02-08 02:57:49,255 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230208fb6c87a1c62f4ee9a1ebd17a6b75499d_del 2023-02-08 02:57:49,255 INFO [Listener at localhost.localdomain/44017] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208fb6c87a1c62f4ee9a1ebd17a6b75499d_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230208fb6c87a1c62f4ee9a1ebd17a6b75499d_del 2023-02-08 02:57:50,086 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c0a14cd63dc4d018af97adb48a37582 2023-02-08 02:57:50,086 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/.tmp/family2/2c0a14cd63dc4d018af97adb48a37582 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/2c0a14cd63dc4d018af97adb48a37582 2023-02-08 02:57:50,090 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c0a14cd63dc4d018af97adb48a37582 2023-02-08 02:57:50,091 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 56fee2d3c0105f54ac56ad88bfb2a274/family2 of 56fee2d3c0105f54ac56ad88bfb2a274 into 2c0a14cd63dc4d018af97adb48a37582(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:57:50,091 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegion(2288): Compaction status journal for 56fee2d3c0105f54ac56ad88bfb2a274: 2023-02-08 02:57:50,091 DEBUG [Listener at localhost.localdomain/44017] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 02:57:50,091 DEBUG [Listener at localhost.localdomain/44017] regionserver.HStore(1912): 78af5cf8f1dc144d3a534e1053ebf08a/family1 is initiating major compaction (all files) 2023-02-08 02:57:50,091 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 02:57:50,092 INFO [Listener at localhost.localdomain/44017] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 02:57:50,092 INFO [Listener at localhost.localdomain/44017] regionserver.HRegion(2258): Starting compaction of 78af5cf8f1dc144d3a534e1053ebf08a/family1 in ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:57:50,092 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/b89a3754e06b47a4a003aba33ec3fd2c, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/00be104fcbba4798a178c5b0b5c7d3ad, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/4ac129cc47b141638550227d138a1f5c, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/47ab22cfa4764de59a5d27616175c8c4, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/ab8d017c43b34107be1df181425c91ca] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp, totalSize=26.6 K 2023-02-08 02:57:50,092 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting b89a3754e06b47a4a003aba33ec3fd2c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825055652 2023-02-08 02:57:50,093 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 00be104fcbba4798a178c5b0b5c7d3ad, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825057589 2023-02-08 02:57:50,093 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 4ac129cc47b141638550227d138a1f5c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825059578 2023-02-08 02:57:50,093 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 47ab22cfa4764de59a5d27616175c8c4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825061506 2023-02-08 02:57:50,094 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting ab8d017c43b34107be1df181425c91ca, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 02:57:50,103 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareThroughputController(145): 78af5cf8f1dc144d3a534e1053ebf08a#family1#compaction#154 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:57:50,113 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/d76d7fb6bcfa4e12b3e99b1794508422, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/bcce0380e90e462a8b0ee85b8ba73f0f, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/ccd7ab06725a48d1974991d6d1671e6e, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/a97bb684411c426884cc7833388eb8cd, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/4880b48f843d408fa863007fcc034b37] to archive 2023-02-08 02:57:50,113 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:50,115 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/d76d7fb6bcfa4e12b3e99b1794508422 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/d76d7fb6bcfa4e12b3e99b1794508422 2023-02-08 02:57:50,116 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/bcce0380e90e462a8b0ee85b8ba73f0f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/bcce0380e90e462a8b0ee85b8ba73f0f 2023-02-08 02:57:50,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/ccd7ab06725a48d1974991d6d1671e6e to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/ccd7ab06725a48d1974991d6d1671e6e 2023-02-08 02:57:50,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/a97bb684411c426884cc7833388eb8cd to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/a97bb684411c426884cc7833388eb8cd 2023-02-08 02:57:50,122 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/4880b48f843d408fa863007fcc034b37 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family2/4880b48f843d408fa863007fcc034b37 2023-02-08 02:57:50,519 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230208f4560d7b276344d8a3f30692e9351ba0_del 2023-02-08 02:57:50,519 INFO [Listener at localhost.localdomain/44017] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208f4560d7b276344d8a3f30692e9351ba0_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230208f4560d7b276344d8a3f30692e9351ba0_del 2023-02-08 02:57:51,350 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fe3bc5250eb24674a696714ef12c20ab 2023-02-08 02:57:51,351 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp/family1/fe3bc5250eb24674a696714ef12c20ab as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/fe3bc5250eb24674a696714ef12c20ab 2023-02-08 02:57:51,357 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fe3bc5250eb24674a696714ef12c20ab 2023-02-08 02:57:51,358 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 78af5cf8f1dc144d3a534e1053ebf08a/family1 of 78af5cf8f1dc144d3a534e1053ebf08a into fe3bc5250eb24674a696714ef12c20ab(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:57:51,358 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegion(2288): Compaction status journal for 78af5cf8f1dc144d3a534e1053ebf08a: 2023-02-08 02:57:51,359 DEBUG [Listener at localhost.localdomain/44017] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 02:57:51,359 DEBUG [Listener at localhost.localdomain/44017] regionserver.HStore(1912): 78af5cf8f1dc144d3a534e1053ebf08a/family2 is initiating major compaction (all files) 2023-02-08 02:57:51,359 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 02:57:51,359 INFO [Listener at localhost.localdomain/44017] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 02:57:51,359 INFO [Listener at localhost.localdomain/44017] regionserver.HRegion(2258): Starting compaction of 78af5cf8f1dc144d3a534e1053ebf08a/family2 in ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:57:51,359 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/b43390a38cfa43f288062298e68e4a31, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/49f7f7370ea847b185d5a78a9afa7230, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/08942173876a48e3884392af6442a2f6, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/e35acfd197124e34a1ac2654cc926bb0, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/02404379d8b349828dd513cf0242d3ff] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp, totalSize=25.3 K 2023-02-08 02:57:51,360 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting b43390a38cfa43f288062298e68e4a31, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825055652 2023-02-08 02:57:51,360 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 49f7f7370ea847b185d5a78a9afa7230, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825057589 2023-02-08 02:57:51,361 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 08942173876a48e3884392af6442a2f6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825059578 2023-02-08 02:57:51,361 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting e35acfd197124e34a1ac2654cc926bb0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825061506 2023-02-08 02:57:51,362 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 02404379d8b349828dd513cf0242d3ff, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 02:57:51,370 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareThroughputController(145): 78af5cf8f1dc144d3a534e1053ebf08a#family2#compaction#155 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:57:51,416 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/b89a3754e06b47a4a003aba33ec3fd2c, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/00be104fcbba4798a178c5b0b5c7d3ad, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/4ac129cc47b141638550227d138a1f5c, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/47ab22cfa4764de59a5d27616175c8c4, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/ab8d017c43b34107be1df181425c91ca] to archive 2023-02-08 02:57:51,417 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:51,420 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/b89a3754e06b47a4a003aba33ec3fd2c to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/b89a3754e06b47a4a003aba33ec3fd2c 2023-02-08 02:57:51,421 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/00be104fcbba4798a178c5b0b5c7d3ad to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/00be104fcbba4798a178c5b0b5c7d3ad 2023-02-08 02:57:51,423 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/4ac129cc47b141638550227d138a1f5c to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/4ac129cc47b141638550227d138a1f5c 2023-02-08 02:57:51,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/47ab22cfa4764de59a5d27616175c8c4 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/47ab22cfa4764de59a5d27616175c8c4 2023-02-08 02:57:51,426 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/ab8d017c43b34107be1df181425c91ca to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/ab8d017c43b34107be1df181425c91ca 2023-02-08 02:57:51,779 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302087ad25ef7ac234b8d92a87e143e7fb72b_del 2023-02-08 02:57:51,779 INFO [Listener at localhost.localdomain/44017] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302087ad25ef7ac234b8d92a87e143e7fb72b_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302087ad25ef7ac234b8d92a87e143e7fb72b_del 2023-02-08 02:57:52,607 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 72548e42985d4f13b71ddf83a10a11c0 2023-02-08 02:57:52,608 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/.tmp/family2/72548e42985d4f13b71ddf83a10a11c0 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/72548e42985d4f13b71ddf83a10a11c0 2023-02-08 02:57:52,614 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 72548e42985d4f13b71ddf83a10a11c0 2023-02-08 02:57:52,615 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 78af5cf8f1dc144d3a534e1053ebf08a/family2 of 78af5cf8f1dc144d3a534e1053ebf08a into 72548e42985d4f13b71ddf83a10a11c0(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:57:52,615 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegion(2288): Compaction status journal for 78af5cf8f1dc144d3a534e1053ebf08a: 2023-02-08 02:57:52,620 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 02:57:52,622 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/b43390a38cfa43f288062298e68e4a31, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/49f7f7370ea847b185d5a78a9afa7230, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/08942173876a48e3884392af6442a2f6, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/e35acfd197124e34a1ac2654cc926bb0, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/02404379d8b349828dd513cf0242d3ff] to archive 2023-02-08 02:57:52,623 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:52,623 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 02:57:52,624 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/b43390a38cfa43f288062298e68e4a31 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/b43390a38cfa43f288062298e68e4a31 2023-02-08 02:57:52,626 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/49f7f7370ea847b185d5a78a9afa7230 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/49f7f7370ea847b185d5a78a9afa7230 2023-02-08 02:57:52,627 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/08942173876a48e3884392af6442a2f6 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/08942173876a48e3884392af6442a2f6 2023-02-08 02:57:52,628 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 02:57:52,628 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/e35acfd197124e34a1ac2654cc926bb0 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/e35acfd197124e34a1ac2654cc926bb0 2023-02-08 02:57:52,629 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 02:57:52,629 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/02404379d8b349828dd513cf0242d3ff to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family2/02404379d8b349828dd513cf0242d3ff 2023-02-08 02:57:52,633 INFO [Listener at localhost.localdomain/44017] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-08 02:57:52,648 INFO [Listener at localhost.localdomain/44017] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-02-08 02:57:52,651 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230208f4560d7b276344d8a3f30692e9351ba0_del 2023-02-08 02:57:52,654 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302085f1521661bf34b18a250ca27d5748759_del 2023-02-08 02:57:52,656 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023020822420096adfd4f589767e15c10d10a21_del 2023-02-08 02:57:52,657 INFO [Listener at localhost.localdomain/44017] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-02-08 02:57:52,657 DEBUG [Listener at localhost.localdomain/44017] zookeeper.ReadOnlyZKClient(139): Connect 0x1201e9c1 to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:57:52,704 DEBUG [Listener at localhost.localdomain/44017] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c8e3c57, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:57:52,706 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230208 for table='ns:testMinorCompaction' and column='family1' 2023-02-08 02:57:52,706 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230208 for table='ns:testMinorCompaction' and column='family1' 2023-02-08 02:57:52,706 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230208 for table='ns:testMinorCompaction' and column='family1' 2023-02-08 02:57:53,537 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020852d3f33fb44340cbbfb17e4c98401137 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023020852d3f33fb44340cbbfb17e4c98401137 2023-02-08 02:57:53,537 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208222b7cc4466d496d9383b8b4fc616c27 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230208222b7cc4466d496d9383b8b4fc616c27 2023-02-08 02:57:53,538 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302082ea5287359bd4489b8e853be5c6bea3b to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302082ea5287359bd4489b8e853be5c6bea3b 2023-02-08 02:57:53,539 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230208 table='ns:testMinorCompaction' column='family1' 2023-02-08 02:57:53,539 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230208 table='ns:testMinorCompaction' column='family1' 2023-02-08 02:57:53,540 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230208 table='ns:testMinorCompaction' column='family1' 2023-02-08 02:57:53,551 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 02:57:53,555 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:49604, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 02:57:53,561 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:53,561 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:53,561 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:53,561 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:53,562 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 02:57:53,567 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:48448, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 02:57:53,567 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:53,567 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:53,568 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:53,568 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:53,583 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230208/family1/c7462c511f0141c1a8814efd5fc8b488 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-02-08 02:57:53,583 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230208/family1/144e15255a144e00a58babcf3d10dcf5 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-02-08 02:57:53,583 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230208/family1/02a4df4952494bf682a6b0d5b3c6b332 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-02-08 02:57:53,584 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230208/family1/c7462c511f0141c1a8814efd5fc8b488}] 2023-02-08 02:57:53,584 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230208/family1/02a4df4952494bf682a6b0d5b3c6b332}] 2023-02-08 02:57:53,584 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230208/family1/144e15255a144e00a58babcf3d10dcf5}] 2023-02-08 02:57:53,591 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230208/family1/c7462c511f0141c1a8814efd5fc8b488 for inclusion in 78af5cf8f1dc144d3a534e1053ebf08a/family1 2023-02-08 02:57:53,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230208/family1/144e15255a144e00a58babcf3d10dcf5 for inclusion in 1fe7fcbdd2a405d19a8041aa386a9bde/family1 2023-02-08 02:57:53,591 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230208/family1/02a4df4952494bf682a6b0d5b3c6b332 for inclusion in 56fee2d3c0105f54ac56ad88bfb2a274/family1 2023-02-08 02:57:53,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-02-08 02:57:53,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-02-08 02:57:53,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-08 02:57:53,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-02-08 02:57:53,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last=1 2023-02-08 02:57:53,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for 1fe7fcbdd2a405d19a8041aa386a9bde: 2023-02-08 02:57:53,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-08 02:57:53,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for 78af5cf8f1dc144d3a534e1053ebf08a: 2023-02-08 02:57:53,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for 56fee2d3c0105f54ac56ad88bfb2a274: 2023-02-08 02:57:53,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230208/family1/144e15255a144e00a58babcf3d10dcf5 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__ns_testMinorCompaction__k0bh4cvklo53p13k5absuqr35lldgoui5q1cocf5c2fegf5mpkmvano7e0aa4lc4/family1/144e15255a144e00a58babcf3d10dcf5 2023-02-08 02:57:53,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230208/family1/c7462c511f0141c1a8814efd5fc8b488 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__ns_testMinorCompaction__f0ptcp5ohauk9rsi0nci626stbvdeotibu3i8lkc3k4hv2r2ulvajfvhcbepcjn3/family1/c7462c511f0141c1a8814efd5fc8b488 2023-02-08 02:57:53,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230208/family1/02a4df4952494bf682a6b0d5b3c6b332 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__ns_testMinorCompaction__krb79ab2978dnvmthje8po8vavualffu2be7gnncbgmlmapig270lovadmuntpem/family1/02a4df4952494bf682a6b0d5b3c6b332 2023-02-08 02:57:53,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__ns_testMinorCompaction__k0bh4cvklo53p13k5absuqr35lldgoui5q1cocf5c2fegf5mpkmvano7e0aa4lc4/family1/144e15255a144e00a58babcf3d10dcf5 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/672c12e994a64d90a5fbce2a62f0d569_SeqId_28_ 2023-02-08 02:57:53,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__ns_testMinorCompaction__f0ptcp5ohauk9rsi0nci626stbvdeotibu3i8lkc3k4hv2r2ulvajfvhcbepcjn3/family1/c7462c511f0141c1a8814efd5fc8b488 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/8f9336161c5a462ebe5e04ede7cb1b7b_SeqId_28_ 2023-02-08 02:57:53,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__ns_testMinorCompaction__krb79ab2978dnvmthje8po8vavualffu2be7gnncbgmlmapig270lovadmuntpem/family1/02a4df4952494bf682a6b0d5b3c6b332 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/9d5c248f61c44a809fd4a60417a5c041_SeqId_28_ 2023-02-08 02:57:53,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__ns_testMinorCompaction__k0bh4cvklo53p13k5absuqr35lldgoui5q1cocf5c2fegf5mpkmvano7e0aa4lc4/family1/144e15255a144e00a58babcf3d10dcf5 into 1fe7fcbdd2a405d19a8041aa386a9bde/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/672c12e994a64d90a5fbce2a62f0d569_SeqId_28_ - updating store file list. 2023-02-08 02:57:53,596 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__ns_testMinorCompaction__f0ptcp5ohauk9rsi0nci626stbvdeotibu3i8lkc3k4hv2r2ulvajfvhcbepcjn3/family1/c7462c511f0141c1a8814efd5fc8b488 into 78af5cf8f1dc144d3a534e1053ebf08a/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/8f9336161c5a462ebe5e04ede7cb1b7b_SeqId_28_ - updating store file list. 2023-02-08 02:57:53,596 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__ns_testMinorCompaction__krb79ab2978dnvmthje8po8vavualffu2be7gnncbgmlmapig270lovadmuntpem/family1/02a4df4952494bf682a6b0d5b3c6b332 into 56fee2d3c0105f54ac56ad88bfb2a274/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/9d5c248f61c44a809fd4a60417a5c041_SeqId_28_ - updating store file list. 2023-02-08 02:57:53,598 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/8f9336161c5a462ebe5e04ede7cb1b7b_SeqId_28_ into 78af5cf8f1dc144d3a534e1053ebf08a/family1 2023-02-08 02:57:53,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/672c12e994a64d90a5fbce2a62f0d569_SeqId_28_ into 1fe7fcbdd2a405d19a8041aa386a9bde/family1 2023-02-08 02:57:53,599 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/9d5c248f61c44a809fd4a60417a5c041_SeqId_28_ into 56fee2d3c0105f54ac56ad88bfb2a274/family1 2023-02-08 02:57:53,599 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__ns_testMinorCompaction__f0ptcp5ohauk9rsi0nci626stbvdeotibu3i8lkc3k4hv2r2ulvajfvhcbepcjn3/family1/c7462c511f0141c1a8814efd5fc8b488 into 78af5cf8f1dc144d3a534e1053ebf08a/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/family1/8f9336161c5a462ebe5e04ede7cb1b7b_SeqId_28_) 2023-02-08 02:57:53,599 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__ns_testMinorCompaction__krb79ab2978dnvmthje8po8vavualffu2be7gnncbgmlmapig270lovadmuntpem/family1/02a4df4952494bf682a6b0d5b3c6b332 into 56fee2d3c0105f54ac56ad88bfb2a274/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/family1/9d5c248f61c44a809fd4a60417a5c041_SeqId_28_) 2023-02-08 02:57:53,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__ns_testMinorCompaction__k0bh4cvklo53p13k5absuqr35lldgoui5q1cocf5c2fegf5mpkmvano7e0aa4lc4/family1/144e15255a144e00a58babcf3d10dcf5 into 1fe7fcbdd2a405d19a8041aa386a9bde/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/family1/672c12e994a64d90a5fbce2a62f0d569_SeqId_28_) 2023-02-08 02:57:53,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__ns_testMinorCompaction__f0ptcp5ohauk9rsi0nci626stbvdeotibu3i8lkc3k4hv2r2ulvajfvhcbepcjn3/family1/c7462c511f0141c1a8814efd5fc8b488 2023-02-08 02:57:53,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__ns_testMinorCompaction__krb79ab2978dnvmthje8po8vavualffu2be7gnncbgmlmapig270lovadmuntpem/family1/02a4df4952494bf682a6b0d5b3c6b332 2023-02-08 02:57:53,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__ns_testMinorCompaction__k0bh4cvklo53p13k5absuqr35lldgoui5q1cocf5c2fegf5mpkmvano7e0aa4lc4/family1/144e15255a144e00a58babcf3d10dcf5 2023-02-08 02:57:53,601 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230208 table='ns:testMinorCompaction' column='family1' 2023-02-08 02:57:53,601 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230208 table='ns:testMinorCompaction' column='family1' 2023-02-08 02:57:53,601 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230208 table='ns:testMinorCompaction' column='family1' 2023-02-08 02:57:53,601 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:53,602 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:53,602 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:57:53,603 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230208840db5092f0046bebd4b070bc6bbe5be to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230208840db5092f0046bebd4b070bc6bbe5be 2023-02-08 02:57:53,603 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230208f7ef871004a44422b20fb42a1b458f61 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230208f7ef871004a44422b20fb42a1b458f61 2023-02-08 02:57:53,603 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-08 02:57:53,603 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-08 02:57:53,603 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230208' 2023-02-08 02:57:53,603 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230208' 2023-02-08 02:57:53,603 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230208e0c214c77de3426ab8c9fe8ee85630d4 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230208e0c214c77de3426ab8c9fe8ee85630d4 2023-02-08 02:57:53,603 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-08 02:57:53,603 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230208' 2023-02-08 02:57:53,603 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230208 for table='ns:testMinorCompaction' and column='family1' 2023-02-08 02:57:53,603 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230208 for table='ns:testMinorCompaction' and column='family1' 2023-02-08 02:57:53,603 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230208 for table='ns:testMinorCompaction' and column='family1' 2023-02-08 02:57:53,604 INFO [Listener at localhost.localdomain/44017] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-02-08 02:57:53,606 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 02:57:53,608 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 02:57:53,610 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 02:57:53,611 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 02:57:53,628 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=245 (was 271), OpenFileDescriptor=618 (was 734), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=84 (was 118), ProcessCount=171 (was 171), AvailableMemoryMB=3221 (was 3227) 2023-02-08 02:57:53,638 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=245, OpenFileDescriptor=618, MaxFileDescriptor=60000, SystemLoadAverage=84, ProcessCount=171, AvailableMemoryMB=3220 2023-02-08 02:57:53,639 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:53,639 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:53,640 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-08 02:57:53,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:53,642 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 02:57:53,642 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-02-08 02:57:53,643 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:53,643 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 02:57:53,643 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:53,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-08 02:57:53,644 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9 2023-02-08 02:57:53,644 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9 empty. 2023-02-08 02:57:53,645 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9 2023-02-08 02:57:53,645 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-02-08 02:57:53,744 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:53,744 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:53,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-08 02:57:53,945 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:53,945 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:53,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-08 02:57:54,054 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-08 02:57:54,058 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => c01292b5ea9d6f39c163a31c0f80d3d9, NAME => 'testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp 2023-02-08 02:57:54,247 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:54,247 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:54,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-08 02:57:54,470 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:57:54,471 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing c01292b5ea9d6f39c163a31c0f80d3d9, disabling compactions & flushes 2023-02-08 02:57:54,471 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:57:54,471 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:57:54,471 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. after waiting 0 ms 2023-02-08 02:57:54,471 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:57:54,471 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:57:54,472 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for c01292b5ea9d6f39c163a31c0f80d3d9: Waiting for close lock at 1675825074471Disabling compacts and flushes for region at 1675825074471Disabling writes for close at 1675825074471Writing region close event to WAL at 1675825074471Closed at 1675825074471 2023-02-08 02:57:54,478 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 02:57:54,481 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675825074480"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675825074480"}]},"ts":"1675825074480"} 2023-02-08 02:57:54,483 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 02:57:54,484 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 02:57:54,484 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675825074484"}]},"ts":"1675825074484"} 2023-02-08 02:57:54,485 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-08 02:57:54,556 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=c01292b5ea9d6f39c163a31c0f80d3d9, ASSIGN}] 2023-02-08 02:57:54,559 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=c01292b5ea9d6f39c163a31c0f80d3d9, ASSIGN 2023-02-08 02:57:54,561 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=c01292b5ea9d6f39c163a31c0f80d3d9, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=false 2023-02-08 02:57:54,713 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=c01292b5ea9d6f39c163a31c0f80d3d9, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:54,713 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675825074713"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675825074713"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675825074713"}]},"ts":"1675825074713"} 2023-02-08 02:57:54,717 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure c01292b5ea9d6f39c163a31c0f80d3d9, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:57:54,749 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(317): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase12.apache.org,44577,1675824910652, timeout=1675825074871, delay=122, operations=[pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure c01292b5ea9d6f39c163a31c0f80d3d9, server=jenkins-hbase12.apache.org,44577,1675824910652]] 2023-02-08 02:57:54,750 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:54,750 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:54,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-08 02:57:54,874 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:57:54,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c01292b5ea9d6f39c163a31c0f80d3d9, NAME => 'testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9.', STARTKEY => '', ENDKEY => ''} 2023-02-08 02:57:54,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy c01292b5ea9d6f39c163a31c0f80d3d9 2023-02-08 02:57:54,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:57:54,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for c01292b5ea9d6f39c163a31c0f80d3d9 2023-02-08 02:57:54,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for c01292b5ea9d6f39c163a31c0f80d3d9 2023-02-08 02:57:54,877 INFO [StoreOpener-c01292b5ea9d6f39c163a31c0f80d3d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c01292b5ea9d6f39c163a31c0f80d3d9 2023-02-08 02:57:54,880 DEBUG [StoreOpener-c01292b5ea9d6f39c163a31c0f80d3d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1 2023-02-08 02:57:54,880 DEBUG [StoreOpener-c01292b5ea9d6f39c163a31c0f80d3d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1 2023-02-08 02:57:54,880 INFO [StoreOpener-c01292b5ea9d6f39c163a31c0f80d3d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c01292b5ea9d6f39c163a31c0f80d3d9 columnFamilyName family1 2023-02-08 02:57:54,883 INFO [StoreOpener-c01292b5ea9d6f39c163a31c0f80d3d9-1] regionserver.HStore(310): Store=c01292b5ea9d6f39c163a31c0f80d3d9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:57:54,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9 2023-02-08 02:57:54,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9 2023-02-08 02:57:54,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for c01292b5ea9d6f39c163a31c0f80d3d9 2023-02-08 02:57:54,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:57:54,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened c01292b5ea9d6f39c163a31c0f80d3d9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70265084, jitterRate=0.04703134298324585}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 02:57:54,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for c01292b5ea9d6f39c163a31c0f80d3d9: Running coprocessor pre-open hook at 1675825074875Writing region info on filesystem at 1675825074875Initializing all the Stores at 1675825074877 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675825074877Cleaning up temporary data from old regions at 1675825074885 (+8 ms)Cleaning up detritus from prior splits at 1675825074885Running coprocessor post-open hooks at 1675825074889 (+4 ms)Region opened successfully at 1675825074889 2023-02-08 02:57:54,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9., pid=114, masterSystemTime=1675825074871 2023-02-08 02:57:54,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:57:54,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:57:54,890 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=c01292b5ea9d6f39c163a31c0f80d3d9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:54,891 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675825074890"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675825074890"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675825074890"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675825074890"}]},"ts":"1675825074890"} 2023-02-08 02:57:54,893 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-02-08 02:57:54,893 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure c01292b5ea9d6f39c163a31c0f80d3d9, server=jenkins-hbase12.apache.org,44577,1675824910652 in 175 msec 2023-02-08 02:57:54,894 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-02-08 02:57:54,894 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=c01292b5ea9d6f39c163a31c0f80d3d9, ASSIGN in 337 msec 2023-02-08 02:57:54,894 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 02:57:54,894 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675825074894"}]},"ts":"1675825074894"} 2023-02-08 02:57:54,895 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-08 02:57:54,904 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 02:57:54,905 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.2640 sec 2023-02-08 02:57:55,752 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:55,752 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:55,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-08 02:57:55,754 INFO [Listener at localhost.localdomain/44017] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-02-08 02:57:55,776 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:55,776 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:55,776 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:57:55,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:55,778 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 02:57:55,778 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:55,778 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 02:57:55,778 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 02:57:55,778 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:55,779 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:55,817 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 02:57:55,871 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:55,871 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:55,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:55,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:55,871 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:55,871 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:57:55,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:55,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:55,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:57:55,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:55,872 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:55,872 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:55,873 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 02:57:55,873 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:55,873 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 02:57:55,873 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:57:55,873 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:57:55,873 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:57:55,873 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. started... 2023-02-08 02:57:55,874 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c01292b5ea9d6f39c163a31c0f80d3d9 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-08 02:57:56,293 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511301c15483a52564d2f8cc450ab0b761034 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511301c15483a52564d2f8cc450ab0b761034 2023-02-08 02:57:56,697 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp/family1/b308f4c7adfb47849a18e97b8ad89547 2023-02-08 02:57:56,709 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp/family1/b308f4c7adfb47849a18e97b8ad89547 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/b308f4c7adfb47849a18e97b8ad89547 2023-02-08 02:57:56,714 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/b308f4c7adfb47849a18e97b8ad89547, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-08 02:57:56,715 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for c01292b5ea9d6f39c163a31c0f80d3d9 in 841ms, sequenceid=5, compaction requested=false 2023-02-08 02:57:56,716 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c01292b5ea9d6f39c163a31c0f80d3d9: 2023-02-08 02:57:56,716 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:57:56,716 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:57:56,716 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:57:56,716 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:56,716 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 02:57:56,716 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-08 02:57:56,777 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:56,777 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:56,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:56,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:56,778 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,778 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:57:56,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:56,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:56,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:56,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:56,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 02:57:56,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b201d58[Count = 0] remaining members to acquire global barrier 2023-02-08 02:57:56,782 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 02:57:56,782 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,787 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,787 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 02:57:56,788 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-08 02:57:56,788 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:57:56,788 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:56,788 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:57:56,798 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 02:57:56,798 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:56,798 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:56,798 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-08 02:57:56,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:56,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:56,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:56,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:56,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:56,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:56,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:56,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:56,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:57:56,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:57:56,801 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-08 02:57:56,801 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:57:56,801 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:57:56,801 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,801 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:57:56,808 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,808 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:56,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:56,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,808 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:56,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:56,809 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:56,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:56,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:56,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:56,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,809 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:56,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:56,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:56,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:56,819 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:56,819 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:56,819 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:56,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 02:57:56,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:56,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:56,819 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:56,819 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 02:57:56,819 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:57:56,819 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,819 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,819 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:56,819 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:56,819 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,819 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:57:56,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:56,820 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:57:56,819 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,920 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:57:56,920 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:56,920 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:56,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:57:56,925 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:56,925 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:56,926 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:57:56,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:57:56,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,927 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 02:57:56,927 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:56,927 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 02:57:56,927 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 02:57:56,928 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,928 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,935 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:56,935 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:56,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:56,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:56,935 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:56,935 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:57:56,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:57:56,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,936 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,936 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 02:57:56,936 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:56,936 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 02:57:56,936 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:56,936 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 02:57:56,936 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:57:56,936 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:57:56,936 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:57:56,936 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. started... 2023-02-08 02:57:56,936 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c01292b5ea9d6f39c163a31c0f80d3d9 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-08 02:57:57,357 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511286cff90a24b84438abf5fb5e52bdf1875 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511286cff90a24b84438abf5fb5e52bdf1875 2023-02-08 02:57:57,767 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp/family1/610a9e91dc7a4b4ab585751eb7c66146 2023-02-08 02:57:57,775 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp/family1/610a9e91dc7a4b4ab585751eb7c66146 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/610a9e91dc7a4b4ab585751eb7c66146 2023-02-08 02:57:57,781 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/610a9e91dc7a4b4ab585751eb7c66146, entries=1, sequenceid=9, filesize=5.0 K 2023-02-08 02:57:57,782 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for c01292b5ea9d6f39c163a31c0f80d3d9 in 846ms, sequenceid=9, compaction requested=false 2023-02-08 02:57:57,782 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c01292b5ea9d6f39c163a31c0f80d3d9: 2023-02-08 02:57:57,782 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:57:57,782 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:57:57,782 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:57:57,782 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:57,782 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 02:57:57,782 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-08 02:57:57,829 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:57,829 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:57,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:57,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:57,830 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,830 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:57:57,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:57,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:57,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:57,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:57,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 02:57:57,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b3767b0[Count = 0] remaining members to acquire global barrier 2023-02-08 02:57:57,832 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 02:57:57,832 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,840 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,840 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 02:57:57,840 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-08 02:57:57,840 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:57:57,840 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:57,840 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:57:57,850 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 02:57:57,850 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:57,850 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:57,851 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-08 02:57:57,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:57,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:57,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:57,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:57,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:57,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:57,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:57,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:57:57,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:57:57,856 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-08 02:57:57,856 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:57:57,856 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:57:57,856 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,856 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:57:57,870 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,870 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,870 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:57,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:57,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:57,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:57,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:57,872 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:57,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:57,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,875 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:57,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:57,919 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:57,919 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:57,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:57,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:57,919 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 02:57:57,919 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:57:57,919 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:57,919 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,919 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:57,920 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,920 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:57:57,920 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:57:57,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 02:57:57,920 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:57,921 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:57,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:57,921 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:57,921 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,020 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:57:58,021 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:58,021 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:58,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:57:58,030 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:58,031 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:58,032 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:57:58,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:57:58,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,034 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 02:57:58,034 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:58,034 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 02:57:58,034 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 02:57:58,034 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,034 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,050 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:58,050 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:58,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:58,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:58,051 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:58,051 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:57:58,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,052 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:57:58,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,053 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,053 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 02:57:58,053 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,053 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 02:57:58,053 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:58,053 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 02:57:58,053 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:57:58,054 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:57:58,054 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:57:58,054 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. started... 2023-02-08 02:57:58,054 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c01292b5ea9d6f39c163a31c0f80d3d9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:57:58,473 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201765d7625d667477cb11146c272c632ad to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201765d7625d667477cb11146c272c632ad 2023-02-08 02:57:58,884 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp/family1/c56062492aaf4dc7a226854d600839bd 2023-02-08 02:57:58,895 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp/family1/c56062492aaf4dc7a226854d600839bd as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/c56062492aaf4dc7a226854d600839bd 2023-02-08 02:57:58,900 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/c56062492aaf4dc7a226854d600839bd, entries=1, sequenceid=13, filesize=4.9 K 2023-02-08 02:57:58,901 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c01292b5ea9d6f39c163a31c0f80d3d9 in 847ms, sequenceid=13, compaction requested=true 2023-02-08 02:57:58,901 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c01292b5ea9d6f39c163a31c0f80d3d9: 2023-02-08 02:57:58,902 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:57:58,902 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:57:58,902 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:57:58,902 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:58,902 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 02:57:58,902 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-08 02:57:58,945 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:58,945 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:58,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:58,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:58,946 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:58,947 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:57:58,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:58,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:58,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:58,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 02:57:58,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ea8e527[Count = 0] remaining members to acquire global barrier 2023-02-08 02:57:58,950 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 02:57:58,950 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,956 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,956 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 02:57:58,956 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:58,957 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:57:58,956 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-08 02:57:58,957 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:57:58,966 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 02:57:58,966 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:58,966 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:58,967 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-08 02:57:58,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:58,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:58,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:58,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:58,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:58,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:58,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:58,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:58,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:57:58,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:57:58,975 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-08 02:57:58,975 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:57:58,975 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:57:58,975 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,975 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:57:58,987 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,987 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:57:58,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:57:58,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,988 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:58,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:57:58,989 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:58,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:58,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:58,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:57:58,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,991 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:58,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:58,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:57:58,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:58,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:59,007 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:59,007 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:59,007 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:57:59,007 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 02:57:59,007 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:59,007 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 02:57:59,007 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:57:59,007 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:59,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:59,007 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:57:59,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:59,007 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:59,007 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:57:59,007 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:59,008 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:57:59,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:57:59,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:57:59,008 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:59,008 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:59,108 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:57:59,108 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:59,108 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:59,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:57:59,113 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:57:59,114 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:57:59,114 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:57:59,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:57:59,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:59,117 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 02:57:59,117 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:59,117 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 02:57:59,117 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 02:57:59,118 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:59,118 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:59,182 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:57:59,182 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:59,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:57:59,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:57:59,250 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:57:59,250 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:57:59,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:59,252 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:59,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:57:59,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:59,254 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:59,254 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 02:57:59,255 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-08 02:57:59,255 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 02:57:59,255 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:57:59,255 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 02:57:59,255 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:57:59,255 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:57:59,256 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:57:59,256 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. started... 2023-02-08 02:57:59,256 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c01292b5ea9d6f39c163a31c0f80d3d9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:57:59,684 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205273057dff3b8489290dabd807da00871 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205273057dff3b8489290dabd807da00871 2023-02-08 02:58:00,090 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp/family1/199c3c03dfcf426982e981617692d97c 2023-02-08 02:58:00,102 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp/family1/199c3c03dfcf426982e981617692d97c as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/199c3c03dfcf426982e981617692d97c 2023-02-08 02:58:00,107 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/199c3c03dfcf426982e981617692d97c, entries=1, sequenceid=17, filesize=4.9 K 2023-02-08 02:58:00,108 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c01292b5ea9d6f39c163a31c0f80d3d9 in 852ms, sequenceid=17, compaction requested=true 2023-02-08 02:58:00,108 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c01292b5ea9d6f39c163a31c0f80d3d9: 2023-02-08 02:58:00,108 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:58:00,108 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:58:00,108 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:58:00,108 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:00,108 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 02:58:00,108 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-08 02:58:00,166 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:00,166 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:00,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:00,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:00,168 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:00,168 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:58:00,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:00,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:00,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:00,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 02:58:00,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@283bc41a[Count = 0] remaining members to acquire global barrier 2023-02-08 02:58:00,173 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 02:58:00,173 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,186 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,187 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 02:58:00,187 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-08 02:58:00,187 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:58:00,187 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:00,187 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:58:00,198 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 02:58:00,198 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:00,198 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:00,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:00,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:00,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:00,198 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-08 02:58:00,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:00,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:00,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:00,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:00,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:00,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:58:00,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:58:00,202 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-08 02:58:00,202 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:58:00,202 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:58:00,202 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,202 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:58:00,208 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,208 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:00,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:00,208 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:00,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:00,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:00,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:00,209 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:00,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:00,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,211 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:00,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:00,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:00,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:00,219 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:00,219 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:00,219 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:00,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:00,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:00,219 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 02:58:00,219 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:58:00,219 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:00,219 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,219 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,220 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:00,220 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,220 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,220 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:00,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:00,220 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:58:00,220 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:58:00,320 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:58:00,321 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:00,321 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:00,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:58:00,332 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:00,332 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:00,333 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:58:00,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:58:00,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,336 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 02:58:00,336 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:58:00,336 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 02:58:00,336 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 02:58:00,336 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,337 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,345 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:00,345 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:00,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:00,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:00,345 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:00,345 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:58:00,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,346 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:58:00,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,346 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,346 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 02:58:00,346 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:00,346 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 02:58:00,346 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:58:00,347 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 02:58:00,347 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:58:00,347 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:58:00,347 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:58:00,347 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. started... 2023-02-08 02:58:00,347 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c01292b5ea9d6f39c163a31c0f80d3d9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:58:00,412 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 02:58:00,764 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f0ac2080be1443c1b5ed951b5ae83cfb to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228f0ac2080be1443c1b5ed951b5ae83cfb 2023-02-08 02:58:01,172 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp/family1/22ea0fb813b747cba6a0dc0d4f49168f 2023-02-08 02:58:01,185 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp/family1/22ea0fb813b747cba6a0dc0d4f49168f as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/22ea0fb813b747cba6a0dc0d4f49168f 2023-02-08 02:58:01,190 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/22ea0fb813b747cba6a0dc0d4f49168f, entries=1, sequenceid=21, filesize=4.9 K 2023-02-08 02:58:01,191 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c01292b5ea9d6f39c163a31c0f80d3d9 in 844ms, sequenceid=21, compaction requested=true 2023-02-08 02:58:01,191 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c01292b5ea9d6f39c163a31c0f80d3d9: 2023-02-08 02:58:01,191 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:58:01,191 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:58:01,191 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:58:01,191 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:01,191 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 02:58:01,191 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-08 02:58:01,261 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:01,261 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:01,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:01,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:01,263 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,263 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:58:01,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:01,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:01,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:01,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:01,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 02:58:01,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73aad698[Count = 0] remaining members to acquire global barrier 2023-02-08 02:58:01,269 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 02:58:01,269 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,282 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,282 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 02:58:01,283 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-08 02:58:01,283 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:58:01,283 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:01,283 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:58:01,293 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 02:58:01,293 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:01,293 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-08 02:58:01,293 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:01,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:01,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:01,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:01,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:01,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:01,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:01,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:01,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:01,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:58:01,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:58:01,303 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-08 02:58:01,303 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:58:01,303 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:58:01,303 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,304 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:58:01,341 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,341 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:01,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,341 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:01,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:01,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:01,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:01,343 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:01,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:01,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:01,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,347 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:01,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:01,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:01,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:01,363 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:01,363 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,363 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,363 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:01,363 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:01,363 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 02:58:01,363 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:58:01,363 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:01,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:01,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:01,363 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:01,364 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:58:01,364 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:58:01,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 02:58:01,364 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:01,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:01,364 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,364 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,464 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:58:01,465 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:01,465 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:01,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:58:01,474 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:01,474 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:01,475 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:58:01,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:58:01,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,477 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 02:58:01,477 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:58:01,477 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 02:58:01,477 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 02:58:01,478 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,478 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,489 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:01,489 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:01,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:01,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:01,490 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:01,490 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:58:01,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,491 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:58:01,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,492 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,493 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 02:58:01,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:01,493 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 02:58:01,493 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:58:01,493 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 02:58:01,494 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:58:01,494 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:58:01,494 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:58:01,494 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. started... 2023-02-08 02:58:01,494 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c01292b5ea9d6f39c163a31c0f80d3d9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:58:01,914 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512318a05fdba4ee14997bdcb68107762527a to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512318a05fdba4ee14997bdcb68107762527a 2023-02-08 02:58:02,321 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp/family1/23e14952aaba4f61ac5af15e105abb6a 2023-02-08 02:58:02,332 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp/family1/23e14952aaba4f61ac5af15e105abb6a as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/23e14952aaba4f61ac5af15e105abb6a 2023-02-08 02:58:02,338 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/23e14952aaba4f61ac5af15e105abb6a, entries=1, sequenceid=25, filesize=4.9 K 2023-02-08 02:58:02,339 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c01292b5ea9d6f39c163a31c0f80d3d9 in 845ms, sequenceid=25, compaction requested=true 2023-02-08 02:58:02,339 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c01292b5ea9d6f39c163a31c0f80d3d9: 2023-02-08 02:58:02,339 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:58:02,340 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:58:02,340 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:58:02,340 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:02,340 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 02:58:02,340 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-08 02:58:02,395 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:02,395 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:02,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:02,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:02,396 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,396 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:58:02,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:02,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:02,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:02,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:02,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 02:58:02,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35035ba[Count = 0] remaining members to acquire global barrier 2023-02-08 02:58:02,401 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 02:58:02,401 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,405 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,405 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 02:58:02,405 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-08 02:58:02,406 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:58:02,406 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:02,406 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:58:02,416 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 02:58:02,416 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:02,416 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:02,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:02,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:02,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:02,416 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-08 02:58:02,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:02,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:02,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:02,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:02,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:58:02,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:58:02,425 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-08 02:58:02,425 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:58:02,425 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:58:02,425 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,425 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:58:02,436 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,436 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:02,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:02,437 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:02,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:02,438 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:02,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:02,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:02,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:02,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,440 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:02,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:02,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:02,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:02,447 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:02,447 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,447 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,447 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:02,447 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:02,447 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:02,447 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 02:58:02,448 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:58:02,447 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,447 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:02,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:02,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:02,448 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,448 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,448 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 02:58:02,448 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:58:02,448 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:58:02,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:02,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:02,549 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:58:02,549 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:02,549 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:02,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:58:02,559 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:02,559 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:02,560 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:58:02,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:58:02,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,563 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 02:58:02,563 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:58:02,563 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 02:58:02,563 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 02:58:02,564 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,564 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,574 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:02,574 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:02,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:02,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:02,575 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:02,575 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:58:02,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,576 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:58:02,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,577 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,578 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 02:58:02,578 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:02,578 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 02:58:02,578 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:58:02,579 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 02:58:02,579 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:58:02,579 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:58:02,579 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:58:02,579 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. started... 2023-02-08 02:58:02,579 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c01292b5ea9d6f39c163a31c0f80d3d9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:58:02,598 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010184dfb5f61b724ff3b58bf5613721840d to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010184dfb5f61b724ff3b58bf5613721840d 2023-02-08 02:58:03,005 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp/family1/691aebd257bd4f25a660c22546fa5342 2023-02-08 02:58:03,014 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp/family1/691aebd257bd4f25a660c22546fa5342 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/691aebd257bd4f25a660c22546fa5342 2023-02-08 02:58:03,019 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/691aebd257bd4f25a660c22546fa5342, entries=1, sequenceid=29, filesize=4.9 K 2023-02-08 02:58:03,020 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c01292b5ea9d6f39c163a31c0f80d3d9 in 441ms, sequenceid=29, compaction requested=true 2023-02-08 02:58:03,021 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c01292b5ea9d6f39c163a31c0f80d3d9: 2023-02-08 02:58:03,021 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:58:03,021 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:58:03,021 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:58:03,021 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:03,021 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 02:58:03,021 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-08 02:58:03,068 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:03,068 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:03,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:03,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:03,069 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,069 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:58:03,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:03,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:03,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:03,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:03,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 02:58:03,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a38792a[Count = 0] remaining members to acquire global barrier 2023-02-08 02:58:03,074 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 02:58:03,074 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,079 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,079 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 02:58:03,079 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-08 02:58:03,079 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:58:03,079 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:03,080 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:58:03,089 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 02:58:03,089 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:03,090 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-08 02:58:03,089 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:03,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:03,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:03,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:03,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:03,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:03,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:03,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:03,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:03,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:58:03,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:58:03,099 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-08 02:58:03,099 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:58:03,099 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:58:03,099 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,099 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:58:03,110 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,110 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:03,110 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:03,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:03,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:03,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:03,112 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:03,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:03,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:03,115 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:03,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:03,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:03,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:03,121 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:03,121 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,121 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,121 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:03,121 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,121 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,121 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:03,121 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:03,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:03,121 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,121 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 02:58:03,121 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:58:03,121 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:03,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 02:58:03,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:03,122 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:58:03,122 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:58:03,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:03,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:03,222 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:58:03,222 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:03,223 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:03,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:58:03,233 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:03,234 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:03,235 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:58:03,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:58:03,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,237 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 02:58:03,237 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:58:03,237 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 02:58:03,237 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 02:58:03,238 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,238 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,247 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:03,247 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:03,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:03,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:03,247 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:03,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,247 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:58:03,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:58:03,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,248 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,249 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 02:58:03,249 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:03,249 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 02:58:03,249 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:58:03,249 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 02:58:03,249 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:58:03,249 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:58:03,249 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:58:03,249 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. started... 2023-02-08 02:58:03,249 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c01292b5ea9d6f39c163a31c0f80d3d9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:58:03,668 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038ea7b2b3de4644f2851dccca63f9958c to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601038ea7b2b3de4644f2851dccca63f9958c 2023-02-08 02:58:04,078 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp/family1/1d30da3a7a86486480780cdab3f45b95 2023-02-08 02:58:04,089 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp/family1/1d30da3a7a86486480780cdab3f45b95 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/1d30da3a7a86486480780cdab3f45b95 2023-02-08 02:58:04,094 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/1d30da3a7a86486480780cdab3f45b95, entries=1, sequenceid=33, filesize=4.9 K 2023-02-08 02:58:04,095 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c01292b5ea9d6f39c163a31c0f80d3d9 in 846ms, sequenceid=33, compaction requested=true 2023-02-08 02:58:04,095 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c01292b5ea9d6f39c163a31c0f80d3d9: 2023-02-08 02:58:04,095 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:58:04,095 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:58:04,095 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:58:04,095 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:04,095 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 02:58:04,095 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-08 02:58:04,152 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:04,152 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:04,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:04,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:04,154 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,154 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:58:04,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:04,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:04,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:04,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:04,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 02:58:04,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cd57b63[Count = 0] remaining members to acquire global barrier 2023-02-08 02:58:04,160 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 02:58:04,161 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,173 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,174 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 02:58:04,174 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-08 02:58:04,174 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:58:04,174 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:04,174 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:58:04,257 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 02:58:04,258 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:04,258 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-08 02:58:04,257 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:04,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:04,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:04,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:04,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:04,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:04,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:58:04,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:58:04,269 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-08 02:58:04,269 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:58:04,269 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:58:04,269 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,269 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:58:04,321 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,321 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,321 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:04,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:04,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:04,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:04,323 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:04,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:04,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:04,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:04,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,327 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:04,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:04,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:04,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:04,402 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:04,403 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,403 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:04,403 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,403 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 02:58:04,403 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:58:04,403 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:04,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 02:58:04,403 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:04,404 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:58:04,404 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:58:04,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:04,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:04,403 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:04,403 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,405 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,405 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:04,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:04,504 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:58:04,505 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:04,505 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:04,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:58:04,514 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:04,514 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:04,515 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:58:04,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:58:04,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,518 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 02:58:04,518 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:58:04,518 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 02:58:04,518 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 02:58:04,518 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,518 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,586 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:04,586 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:04,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:04,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:04,588 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:04,588 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:58:04,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:58:04,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,591 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,591 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 02:58:04,592 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:04,592 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 02:58:04,592 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:58:04,592 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 02:58:04,592 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:58:04,592 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:58:04,592 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:58:04,592 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. started... 2023-02-08 02:58:04,593 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c01292b5ea9d6f39c163a31c0f80d3d9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:58:04,612 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907bad95bb2bb6c48f3a94717c265f848fc to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907bad95bb2bb6c48f3a94717c265f848fc 2023-02-08 02:58:05,020 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp/family1/5ca46254c2d64f62a979a6fd814a2ddf 2023-02-08 02:58:05,030 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp/family1/5ca46254c2d64f62a979a6fd814a2ddf as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/5ca46254c2d64f62a979a6fd814a2ddf 2023-02-08 02:58:05,039 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/5ca46254c2d64f62a979a6fd814a2ddf, entries=1, sequenceid=37, filesize=4.9 K 2023-02-08 02:58:05,040 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c01292b5ea9d6f39c163a31c0f80d3d9 in 447ms, sequenceid=37, compaction requested=true 2023-02-08 02:58:05,040 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c01292b5ea9d6f39c163a31c0f80d3d9: 2023-02-08 02:58:05,040 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:58:05,040 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:58:05,040 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:58:05,040 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:05,040 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 02:58:05,040 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-08 02:58:05,110 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:05,110 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:05,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:05,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:05,112 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,112 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:58:05,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:05,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:05,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:05,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:05,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 02:58:05,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39ee6077[Count = 0] remaining members to acquire global barrier 2023-02-08 02:58:05,118 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 02:58:05,118 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,131 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,132 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 02:58:05,132 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-08 02:58:05,132 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:58:05,132 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:05,133 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:58:05,142 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 02:58:05,142 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:05,142 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-08 02:58:05,142 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:05,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:05,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:05,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:05,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:05,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:05,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:05,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:05,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:05,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:58:05,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:58:05,152 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-08 02:58:05,152 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:58:05,152 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:58:05,153 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,153 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:58:05,163 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,163 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:05,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:05,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,163 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:05,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:05,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:05,164 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:05,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:05,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:05,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,167 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:05,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:05,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:05,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:05,173 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:05,173 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:05,173 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,174 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,174 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 02:58:05,174 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:58:05,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:05,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:05,173 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:05,174 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 02:58:05,174 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:58:05,174 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:05,174 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:05,174 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,174 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,174 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:58:05,175 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:05,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:05,275 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:58:05,275 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:05,275 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:05,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:58:05,286 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:05,286 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:05,287 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:58:05,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 02:58:05,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,289 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 02:58:05,289 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:58:05,289 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 02:58:05,289 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 02:58:05,290 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,290 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,300 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:05,300 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:05,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:05,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:05,301 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:05,301 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:58:05,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:58:05,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,303 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,304 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 02:58:05,304 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:05,304 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 02:58:05,304 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:58:05,304 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 02:58:05,304 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 02:58:05,304 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:58:05,305 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:58:05,305 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. started... 2023-02-08 02:58:05,305 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c01292b5ea9d6f39c163a31c0f80d3d9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 02:58:05,729 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120dec477026d5347e3915c810d51093acd to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120dec477026d5347e3915c810d51093acd 2023-02-08 02:58:06,136 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp/family1/8991a41526c9468d9bda6c8e31b4eaf6 2023-02-08 02:58:06,146 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp/family1/8991a41526c9468d9bda6c8e31b4eaf6 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/8991a41526c9468d9bda6c8e31b4eaf6 2023-02-08 02:58:06,151 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/8991a41526c9468d9bda6c8e31b4eaf6, entries=1, sequenceid=41, filesize=4.9 K 2023-02-08 02:58:06,152 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c01292b5ea9d6f39c163a31c0f80d3d9 in 847ms, sequenceid=41, compaction requested=true 2023-02-08 02:58:06,152 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c01292b5ea9d6f39c163a31c0f80d3d9: 2023-02-08 02:58:06,152 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:58:06,152 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 02:58:06,152 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 02:58:06,152 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:06,152 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 02:58:06,152 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-08 02:58:06,258 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:06,258 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:06,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:06,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:06,259 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,259 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:58:06,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:06,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:06,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:06,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:06,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 02:58:06,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b116f15[Count = 0] remaining members to acquire global barrier 2023-02-08 02:58:06,264 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 02:58:06,264 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,268 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,268 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 02:58:06,268 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-08 02:58:06,268 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:58:06,268 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:06,269 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:58:06,278 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 02:58:06,278 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:06,278 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:06,279 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-08 02:58:06,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:06,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:06,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:06,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:06,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:06,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:06,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:06,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:06,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:58:06,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 02:58:06,285 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-08 02:58:06,286 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:58:06,286 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:58:06,286 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,286 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:58:06,300 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,300 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:06,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:06,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,300 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:06,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:06,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:06,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:06,302 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:06,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:06,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:06,305 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:06,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:06,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:06,321 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:06,321 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:06,321 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:06,321 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,321 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 02:58:06,321 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:58:06,321 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:06,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:06,321 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,321 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:06,321 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:06,322 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,321 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 02:58:06,322 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:58:06,322 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:06,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:06,422 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:58:06,422 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:06,423 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:06,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:58:06,438 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-02-08 02:58:06,441 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 02:58:06,441 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 02:58:06,442 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:58:06,442 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675825686442 2023-02-08 02:58:06,444 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-08 02:58:06,445 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-08 02:58:06,445 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 02:58:06,445 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] zookeeper.ReadOnlyZKClient(139): Connect 0x5ee8f511 to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:58:06,458 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@576485a4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:58:06,458 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 02:58:07,290 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010305731b2e5962495fa08c8b3436dbd518 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010305731b2e5962495fa08c8b3436dbd518 2023-02-08 02:58:07,291 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 02:58:07,305 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 02:58:07,307 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:49274, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 02:58:07,311 INFO [MobCompactor-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:07,311 INFO [MobCompactor-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:07,312 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 02:58:07,313 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:36660, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 02:58:07,320 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/298a0e55c6244069b2aea2048180d27c first=Optional[r5] last=Optional[r6] 2023-02-08 02:58:07,321 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/298a0e55c6244069b2aea2048180d27c}] 2023-02-08 02:58:07,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/298a0e55c6244069b2aea2048180d27c for inclusion in c01292b5ea9d6f39c163a31c0f80d3d9/family1 2023-02-08 02:58:07,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-08 02:58:07,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 02:58:07,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for c01292b5ea9d6f39c163a31c0f80d3d9: 2023-02-08 02:58:07,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/298a0e55c6244069b2aea2048180d27c to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ifr1rr9h962v9jgu0vnd03m6gs7gnh9ktrm589d8j0f42mq255um8t4jct3fpcgg/family1/298a0e55c6244069b2aea2048180d27c 2023-02-08 02:58:07,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ifr1rr9h962v9jgu0vnd03m6gs7gnh9ktrm589d8j0f42mq255um8t4jct3fpcgg/family1/298a0e55c6244069b2aea2048180d27c as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/498b2bb1796a46239a39ba33b9b6d905_SeqId_44_ 2023-02-08 02:58:07,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ifr1rr9h962v9jgu0vnd03m6gs7gnh9ktrm589d8j0f42mq255um8t4jct3fpcgg/family1/298a0e55c6244069b2aea2048180d27c into c01292b5ea9d6f39c163a31c0f80d3d9/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/498b2bb1796a46239a39ba33b9b6d905_SeqId_44_ - updating store file list. 2023-02-08 02:58:07,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/498b2bb1796a46239a39ba33b9b6d905_SeqId_44_ into c01292b5ea9d6f39c163a31c0f80d3d9/family1 2023-02-08 02:58:07,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ifr1rr9h962v9jgu0vnd03m6gs7gnh9ktrm589d8j0f42mq255um8t4jct3fpcgg/family1/298a0e55c6244069b2aea2048180d27c into c01292b5ea9d6f39c163a31c0f80d3d9/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/498b2bb1796a46239a39ba33b9b6d905_SeqId_44_) 2023-02-08 02:58:07,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ifr1rr9h962v9jgu0vnd03m6gs7gnh9ktrm589d8j0f42mq255um8t4jct3fpcgg/family1/298a0e55c6244069b2aea2048180d27c 2023-02-08 02:58:07,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-08 02:58:07,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-08 02:58:07,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(1912): c01292b5ea9d6f39c163a31c0f80d3d9/family1 is initiating minor compaction 2023-02-08 02:58:07,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@44fff4b1; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-08 02:58:07,336 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of c01292b5ea9d6f39c163a31c0f80d3d9/family1 in testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:58:07,337 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/610a9e91dc7a4b4ab585751eb7c66146, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/c56062492aaf4dc7a226854d600839bd, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/199c3c03dfcf426982e981617692d97c, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/22ea0fb813b747cba6a0dc0d4f49168f, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/23e14952aaba4f61ac5af15e105abb6a, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/691aebd257bd4f25a660c22546fa5342, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/1d30da3a7a86486480780cdab3f45b95, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/5ca46254c2d64f62a979a6fd814a2ddf, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/8991a41526c9468d9bda6c8e31b4eaf6, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/498b2bb1796a46239a39ba33b9b6d905_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp, totalSize=49.7 K 2023-02-08 02:58:07,337 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 610a9e91dc7a4b4ab585751eb7c66146, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-08 02:58:07,337 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting c56062492aaf4dc7a226854d600839bd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-08 02:58:07,337 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 199c3c03dfcf426982e981617692d97c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-08 02:58:07,337 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 22ea0fb813b747cba6a0dc0d4f49168f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-08 02:58:07,337 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 23e14952aaba4f61ac5af15e105abb6a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-08 02:58:07,337 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 691aebd257bd4f25a660c22546fa5342, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-08 02:58:07,337 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 1d30da3a7a86486480780cdab3f45b95, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-08 02:58:07,337 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 5ca46254c2d64f62a979a6fd814a2ddf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-08 02:58:07,337 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 8991a41526c9468d9bda6c8e31b4eaf6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-08 02:58:07,337 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 498b2bb1796a46239a39ba33b9b6d905_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-08 02:58:07,338 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 02:58:07,339 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:58:07,340 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010184dfb5f61b724ff3b58bf5613721840d to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010184dfb5f61b724ff3b58bf5613721840d 2023-02-08 02:58:07,340 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601038ea7b2b3de4644f2851dccca63f9958c to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601038ea7b2b3de4644f2851dccca63f9958c 2023-02-08 02:58:07,341 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-08 02:58:07,341 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-08 02:58:07,341 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 02:58:07,341 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 02:58:07,353 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] throttle.PressureAwareThroughputController(145): c01292b5ea9d6f39c163a31c0f80d3d9#family1#compaction#166 average throughput is 1.37 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-08 02:58:08,174 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp/family1/b5c4d2f87b6a4aabba58113629f26cfa as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/b5c4d2f87b6a4aabba58113629f26cfa 2023-02-08 02:58:08,178 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231237c2ce5d45c4ae68d2a493532b66845 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231237c2ce5d45c4ae68d2a493532b66845 2023-02-08 02:58:08,178 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in c01292b5ea9d6f39c163a31c0f80d3d9/family1 of c01292b5ea9d6f39c163a31c0f80d3d9 into b5c4d2f87b6a4aabba58113629f26cfa(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 02:58:08,178 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for c01292b5ea9d6f39c163a31c0f80d3d9: 2023-02-08 02:58:08,178 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1675825087336; duration=0sec 2023-02-08 02:58:08,179 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:58:08,179 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 02:58:08,197 INFO [MobCompactor-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:08,198 INFO [MobCompactor-pool-1] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:08,204 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/a00079f90ad44796a256ef54c7d1e7ab first=Optional[r1] last=Optional[r4] 2023-02-08 02:58:08,205 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/a00079f90ad44796a256ef54c7d1e7ab}] 2023-02-08 02:58:08,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/a00079f90ad44796a256ef54c7d1e7ab for inclusion in c01292b5ea9d6f39c163a31c0f80d3d9/family1 2023-02-08 02:58:08,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-08 02:58:08,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 02:58:08,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for c01292b5ea9d6f39c163a31c0f80d3d9: 2023-02-08 02:58:08,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/a00079f90ad44796a256ef54c7d1e7ab to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7jh6usjronog74dksb3g2s83jopnk820reqs0t380lmv1dgi5r3i75t1fg5iujov/family1/a00079f90ad44796a256ef54c7d1e7ab 2023-02-08 02:58:08,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7jh6usjronog74dksb3g2s83jopnk820reqs0t380lmv1dgi5r3i75t1fg5iujov/family1/a00079f90ad44796a256ef54c7d1e7ab as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/05cd1dda42f84eb58d85d6388d1ae042_SeqId_47_ 2023-02-08 02:58:08,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7jh6usjronog74dksb3g2s83jopnk820reqs0t380lmv1dgi5r3i75t1fg5iujov/family1/a00079f90ad44796a256ef54c7d1e7ab into c01292b5ea9d6f39c163a31c0f80d3d9/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/05cd1dda42f84eb58d85d6388d1ae042_SeqId_47_ - updating store file list. 2023-02-08 02:58:08,214 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/610a9e91dc7a4b4ab585751eb7c66146, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/c56062492aaf4dc7a226854d600839bd, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/199c3c03dfcf426982e981617692d97c, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/22ea0fb813b747cba6a0dc0d4f49168f, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/23e14952aaba4f61ac5af15e105abb6a, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/691aebd257bd4f25a660c22546fa5342, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/1d30da3a7a86486480780cdab3f45b95, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/5ca46254c2d64f62a979a6fd814a2ddf, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/8991a41526c9468d9bda6c8e31b4eaf6, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/498b2bb1796a46239a39ba33b9b6d905_SeqId_44_] to archive 2023-02-08 02:58:08,214 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:58:08,216 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/610a9e91dc7a4b4ab585751eb7c66146 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/610a9e91dc7a4b4ab585751eb7c66146 2023-02-08 02:58:08,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/05cd1dda42f84eb58d85d6388d1ae042_SeqId_47_ into c01292b5ea9d6f39c163a31c0f80d3d9/family1 2023-02-08 02:58:08,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7jh6usjronog74dksb3g2s83jopnk820reqs0t380lmv1dgi5r3i75t1fg5iujov/family1/a00079f90ad44796a256ef54c7d1e7ab into c01292b5ea9d6f39c163a31c0f80d3d9/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/05cd1dda42f84eb58d85d6388d1ae042_SeqId_47_) 2023-02-08 02:58:08,217 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/c56062492aaf4dc7a226854d600839bd to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/c56062492aaf4dc7a226854d600839bd 2023-02-08 02:58:08,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7jh6usjronog74dksb3g2s83jopnk820reqs0t380lmv1dgi5r3i75t1fg5iujov/family1/a00079f90ad44796a256ef54c7d1e7ab 2023-02-08 02:58:08,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-08 02:58:08,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-08 02:58:08,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(1912): c01292b5ea9d6f39c163a31c0f80d3d9/family1 is initiating minor compaction (all files) 2023-02-08 02:58:08,218 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/199c3c03dfcf426982e981617692d97c to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/199c3c03dfcf426982e981617692d97c 2023-02-08 02:58:08,218 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of c01292b5ea9d6f39c163a31c0f80d3d9/family1 in testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:58:08,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1ddb9f7f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:58:08,218 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/b308f4c7adfb47849a18e97b8ad89547, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/b5c4d2f87b6a4aabba58113629f26cfa, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/05cd1dda42f84eb58d85d6388d1ae042_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp, totalSize=178.1 K 2023-02-08 02:58:08,219 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting b308f4c7adfb47849a18e97b8ad89547, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878815769 2023-02-08 02:58:08,219 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting b5c4d2f87b6a4aabba58113629f26cfa, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621215769 2023-02-08 02:58:08,219 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] compactions.Compactor(207): Compacting 05cd1dda42f84eb58d85d6388d1ae042_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965215769 2023-02-08 02:58:08,219 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/22ea0fb813b747cba6a0dc0d4f49168f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/22ea0fb813b747cba6a0dc0d4f49168f 2023-02-08 02:58:08,220 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 02:58:08,221 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:58:08,221 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/23e14952aaba4f61ac5af15e105abb6a to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/23e14952aaba4f61ac5af15e105abb6a 2023-02-08 02:58:08,222 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/691aebd257bd4f25a660c22546fa5342 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/691aebd257bd4f25a660c22546fa5342 2023-02-08 02:58:08,222 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201765d7625d667477cb11146c272c632ad to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201765d7625d667477cb11146c272c632ad 2023-02-08 02:58:08,223 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205273057dff3b8489290dabd807da00871 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205273057dff3b8489290dabd807da00871 2023-02-08 02:58:08,223 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/1d30da3a7a86486480780cdab3f45b95 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/1d30da3a7a86486480780cdab3f45b95 2023-02-08 02:58:08,224 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228f0ac2080be1443c1b5ed951b5ae83cfb to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228f0ac2080be1443c1b5ed951b5ae83cfb 2023-02-08 02:58:08,224 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/5ca46254c2d64f62a979a6fd814a2ddf to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/5ca46254c2d64f62a979a6fd814a2ddf 2023-02-08 02:58:08,225 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512318a05fdba4ee14997bdcb68107762527a to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512318a05fdba4ee14997bdcb68107762527a 2023-02-08 02:58:08,225 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/8991a41526c9468d9bda6c8e31b4eaf6 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/8991a41526c9468d9bda6c8e31b4eaf6 2023-02-08 02:58:08,225 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-08 02:58:08,225 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-08 02:58:08,226 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 02:58:08,226 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 02:58:08,226 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/498b2bb1796a46239a39ba33b9b6d905_SeqId_44_ to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/498b2bb1796a46239a39ba33b9b6d905_SeqId_44_ 2023-02-08 02:58:08,233 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] throttle.PressureAwareThroughputController(145): c01292b5ea9d6f39c163a31c0f80d3d9#family1#compaction#167 average throughput is 25.93 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-08 02:58:08,669 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511305572a6da927743ff8353217ce6ee92c7 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511305572a6da927743ff8353217ce6ee92c7 2023-02-08 02:58:08,671 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 02:58:08,688 INFO [MobCompactor-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:08,688 INFO [MobCompactor-pool-1] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:08,694 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/3d52efe9776b4379b9b8e130a3176c86 first=Optional[r00] last=Optional[r8] 2023-02-08 02:58:08,695 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/3d52efe9776b4379b9b8e130a3176c86}] 2023-02-08 02:58:08,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/3d52efe9776b4379b9b8e130a3176c86 for inclusion in c01292b5ea9d6f39c163a31c0f80d3d9/family1 2023-02-08 02:58:08,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-08 02:58:08,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 02:58:08,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for c01292b5ea9d6f39c163a31c0f80d3d9: 2023-02-08 02:58:08,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/3d52efe9776b4379b9b8e130a3176c86 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithMonthlyPolicy__gvjcs0te6idtmbo5ravjnjbcmcmh9njuar771eljc97cmvsfb6em8om1cvo0p9g4/family1/3d52efe9776b4379b9b8e130a3176c86 2023-02-08 02:58:08,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithMonthlyPolicy__gvjcs0te6idtmbo5ravjnjbcmcmh9njuar771eljc97cmvsfb6em8om1cvo0p9g4/family1/3d52efe9776b4379b9b8e130a3176c86 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/c3b4f39b94114225ad4097f6be82d454_SeqId_49_ 2023-02-08 02:58:08,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithMonthlyPolicy__gvjcs0te6idtmbo5ravjnjbcmcmh9njuar771eljc97cmvsfb6em8om1cvo0p9g4/family1/3d52efe9776b4379b9b8e130a3176c86 into c01292b5ea9d6f39c163a31c0f80d3d9/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/c3b4f39b94114225ad4097f6be82d454_SeqId_49_ - updating store file list. 2023-02-08 02:58:08,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/c3b4f39b94114225ad4097f6be82d454_SeqId_49_ into c01292b5ea9d6f39c163a31c0f80d3d9/family1 2023-02-08 02:58:08,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithMonthlyPolicy__gvjcs0te6idtmbo5ravjnjbcmcmh9njuar771eljc97cmvsfb6em8om1cvo0p9g4/family1/3d52efe9776b4379b9b8e130a3176c86 into c01292b5ea9d6f39c163a31c0f80d3d9/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/c3b4f39b94114225ad4097f6be82d454_SeqId_49_) 2023-02-08 02:58:08,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMinorCompactionWithMonthlyPolicy__gvjcs0te6idtmbo5ravjnjbcmcmh9njuar771eljc97cmvsfb6em8om1cvo0p9g4/family1/3d52efe9776b4379b9b8e130a3176c86 2023-02-08 02:58:08,706 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 02:58:08,706 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:58:08,707 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120dec477026d5347e3915c810d51093acd to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120dec477026d5347e3915c810d51093acd 2023-02-08 02:58:08,708 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511286cff90a24b84438abf5fb5e52bdf1875 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511286cff90a24b84438abf5fb5e52bdf1875 2023-02-08 02:58:08,709 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511301c15483a52564d2f8cc450ab0b761034 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511301c15483a52564d2f8cc450ab0b761034 2023-02-08 02:58:08,709 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-08 02:58:08,709 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-08 02:58:08,709 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 02:58:08,709 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 02:58:08,709 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 02:58:08,709 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 02:58:08,709 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:58:08,711 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 02:58:08,712 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.2710 sec 2023-02-08 02:58:08,887 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=252 (was 245) - Thread LEAK? -, OpenFileDescriptor=637 (was 618) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=95 (was 84) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=3209 (was 3220) 2023-02-08 02:58:08,898 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=252, OpenFileDescriptor=637, MaxFileDescriptor=60000, SystemLoadAverage=95, ProcessCount=171, AvailableMemoryMB=3209 2023-02-08 02:58:08,915 DEBUG [Listener at localhost.localdomain/44017] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-02-08 02:58:08,933 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:08,934 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:08,958 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10l\xD05zL\xEB\x8Em\xF5\x89\xA3j\x9A\xD9m\xD6"\x10:\xD1`?\xDB?\xAB\xFDO!\x8Ck>\x11\x18\xE5*\x10-_\xD7\xB3\x88\xD8B%;*F\xBA\x0F\xB8\x02\x802\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-08 02:58:08,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-02-08 02:58:08,960 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 02:58:08,960 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-02-08 02:58:08,961 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:08,961 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:08,961 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 02:58:08,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-08 02:58:08,963 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79 2023-02-08 02:58:08,963 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518 2023-02-08 02:58:08,963 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632 2023-02-08 02:58:08,963 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79 empty. 2023-02-08 02:58:08,963 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518 empty. 2023-02-08 02:58:08,963 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632 empty. 2023-02-08 02:58:08,963 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79 2023-02-08 02:58:08,963 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518 2023-02-08 02:58:08,963 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632 2023-02-08 02:58:08,964 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-02-08 02:58:09,062 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:09,062 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:09,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-08 02:58:09,264 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:09,264 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:09,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-08 02:58:09,371 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-02-08 02:58:09,373 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7671): creating {ENCODED => c9c0e8bea9bed94731a60f71dbfa6b79, NAME => 'testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10l\xD05zL\xEB\x8Em\xF5\x89\xA3j\x9A\xD9m\xD6"\x10:\xD1`?\xDB?\xAB\xFDO!\x8Ck>\x11\x18\xE5*\x10-_\xD7\xB3\x88\xD8B%;*F\xBA\x0F\xB8\x02\x802\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp 2023-02-08 02:58:09,374 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7671): creating {ENCODED => fe25389ddac66aa7aadc2e3f393d5632, NAME => 'testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10l\xD05zL\xEB\x8Em\xF5\x89\xA3j\x9A\xD9m\xD6"\x10:\xD1`?\xDB?\xAB\xFDO!\x8Ck>\x11\x18\xE5*\x10-_\xD7\xB3\x88\xD8B%;*F\xBA\x0F\xB8\x02\x802\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp 2023-02-08 02:58:09,375 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1a1069b4442f7236a13b51c4da18e518, NAME => 'testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10l\xD05zL\xEB\x8Em\xF5\x89\xA3j\x9A\xD9m\xD6"\x10:\xD1`?\xDB?\xAB\xFDO!\x8Ck>\x11\x18\xE5*\x10-_\xD7\xB3\x88\xD8B%;*F\xBA\x0F\xB8\x02\x802\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/.tmp 2023-02-08 02:58:09,417 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:58:09,417 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1603): Closing fe25389ddac66aa7aadc2e3f393d5632, disabling compactions & flushes 2023-02-08 02:58:09,417 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:09,417 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:09,417 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. after waiting 0 ms 2023-02-08 02:58:09,417 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:09,417 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:09,417 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1557): Region close journal for fe25389ddac66aa7aadc2e3f393d5632: Waiting for close lock at 1675825089417Disabling compacts and flushes for region at 1675825089417Disabling writes for close at 1675825089417Writing region close event to WAL at 1675825089417Closed at 1675825089417 2023-02-08 02:58:09,472 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/.tmp/family1/fac8e61eeea84b43a3de2e6a84d70cd4 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/fac8e61eeea84b43a3de2e6a84d70cd4 2023-02-08 02:58:09,478 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in c01292b5ea9d6f39c163a31c0f80d3d9/family1 of c01292b5ea9d6f39c163a31c0f80d3d9 into fac8e61eeea84b43a3de2e6a84d70cd4(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:58:09,478 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for c01292b5ea9d6f39c163a31c0f80d3d9: 2023-02-08 02:58:09,478 INFO [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1675825088218; duration=1sec 2023-02-08 02:58:09,478 DEBUG [RS:0;jenkins-hbase12:44577-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 02:58:09,512 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/b308f4c7adfb47849a18e97b8ad89547, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/b5c4d2f87b6a4aabba58113629f26cfa, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/05cd1dda42f84eb58d85d6388d1ae042_SeqId_47_] to archive 2023-02-08 02:58:09,513 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:58:09,516 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/b308f4c7adfb47849a18e97b8ad89547 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/b308f4c7adfb47849a18e97b8ad89547 2023-02-08 02:58:09,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/b5c4d2f87b6a4aabba58113629f26cfa to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/b5c4d2f87b6a4aabba58113629f26cfa 2023-02-08 02:58:09,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/05cd1dda42f84eb58d85d6388d1ae042_SeqId_47_ to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/family1/05cd1dda42f84eb58d85d6388d1ae042_SeqId_47_ 2023-02-08 02:58:09,566 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:09,567 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:09,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-08 02:58:09,817 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:58:09,817 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:58:09,817 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1603): Closing c9c0e8bea9bed94731a60f71dbfa6b79, disabling compactions & flushes 2023-02-08 02:58:09,817 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:09,817 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:09,817 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1603): Closing 1a1069b4442f7236a13b51c4da18e518, disabling compactions & flushes 2023-02-08 02:58:09,817 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. after waiting 0 ms 2023-02-08 02:58:09,817 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:09,817 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:09,817 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:09,817 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:09,817 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1557): Region close journal for c9c0e8bea9bed94731a60f71dbfa6b79: Waiting for close lock at 1675825089817Disabling compacts and flushes for region at 1675825089817Disabling writes for close at 1675825089817Writing region close event to WAL at 1675825089817Closed at 1675825089817 2023-02-08 02:58:09,817 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. after waiting 0 ms 2023-02-08 02:58:09,817 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:09,818 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:09,818 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1557): Region close journal for 1a1069b4442f7236a13b51c4da18e518: Waiting for close lock at 1675825089817Disabling compacts and flushes for region at 1675825089817Disabling writes for close at 1675825089817Writing region close event to WAL at 1675825089818 (+1 ms)Closed at 1675825089818 2023-02-08 02:58:09,820 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 02:58:09,821 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675825089821"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675825089821"}]},"ts":"1675825089821"} 2023-02-08 02:58:09,822 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675825089821"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675825089821"}]},"ts":"1675825089821"} 2023-02-08 02:58:09,822 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1675825089821"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675825089821"}]},"ts":"1675825089821"} 2023-02-08 02:58:09,825 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-08 02:58:09,826 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 02:58:09,826 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675825089826"}]},"ts":"1675825089826"} 2023-02-08 02:58:09,827 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-02-08 02:58:09,977 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c9c0e8bea9bed94731a60f71dbfa6b79, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1a1069b4442f7236a13b51c4da18e518, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=fe25389ddac66aa7aadc2e3f393d5632, ASSIGN}] 2023-02-08 02:58:09,981 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=fe25389ddac66aa7aadc2e3f393d5632, ASSIGN 2023-02-08 02:58:09,982 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c9c0e8bea9bed94731a60f71dbfa6b79, ASSIGN 2023-02-08 02:58:09,982 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1a1069b4442f7236a13b51c4da18e518, ASSIGN 2023-02-08 02:58:09,984 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=fe25389ddac66aa7aadc2e3f393d5632, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=false 2023-02-08 02:58:09,984 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c9c0e8bea9bed94731a60f71dbfa6b79, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=false 2023-02-08 02:58:09,984 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1a1069b4442f7236a13b51c4da18e518, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,44577,1675824910652; forceNewPlan=false, retain=false 2023-02-08 02:58:10,068 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:10,068 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:10,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-08 02:58:10,138 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=c9c0e8bea9bed94731a60f71dbfa6b79, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:10,138 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=fe25389ddac66aa7aadc2e3f393d5632, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:10,138 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675825090137"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675825090137"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675825090137"}]},"ts":"1675825090137"} 2023-02-08 02:58:10,138 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=1a1069b4442f7236a13b51c4da18e518, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:10,138 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675825090138"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675825090138"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675825090138"}]},"ts":"1675825090138"} 2023-02-08 02:58:10,139 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1675825090138"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675825090138"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675825090138"}]},"ts":"1675825090138"} 2023-02-08 02:58:10,141 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure c9c0e8bea9bed94731a60f71dbfa6b79, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:58:10,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=119, state=RUNNABLE; OpenRegionProcedure fe25389ddac66aa7aadc2e3f393d5632, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:58:10,143 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=118, state=RUNNABLE; OpenRegionProcedure 1a1069b4442f7236a13b51c4da18e518, server=jenkins-hbase12.apache.org,44577,1675824910652}] 2023-02-08 02:58:10,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:10,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1a1069b4442f7236a13b51c4da18e518, NAME => 'testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518.', STARTKEY => '1', ENDKEY => '2'} 2023-02-08 02:58:10,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 1a1069b4442f7236a13b51c4da18e518 2023-02-08 02:58:10,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:58:10,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 1a1069b4442f7236a13b51c4da18e518 2023-02-08 02:58:10,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 1a1069b4442f7236a13b51c4da18e518 2023-02-08 02:58:10,324 INFO [StoreOpener-1a1069b4442f7236a13b51c4da18e518-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1a1069b4442f7236a13b51c4da18e518 2023-02-08 02:58:10,325 DEBUG [StoreOpener-1a1069b4442f7236a13b51c4da18e518-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1 2023-02-08 02:58:10,326 DEBUG [StoreOpener-1a1069b4442f7236a13b51c4da18e518-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1 2023-02-08 02:58:10,326 INFO [StoreOpener-1a1069b4442f7236a13b51c4da18e518-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a1069b4442f7236a13b51c4da18e518 columnFamilyName family1 2023-02-08 02:58:10,327 INFO [StoreOpener-1a1069b4442f7236a13b51c4da18e518-1] regionserver.HStore(310): Store=1a1069b4442f7236a13b51c4da18e518/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:58:10,327 INFO [StoreOpener-1a1069b4442f7236a13b51c4da18e518-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1a1069b4442f7236a13b51c4da18e518 2023-02-08 02:58:10,328 DEBUG [StoreOpener-1a1069b4442f7236a13b51c4da18e518-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2 2023-02-08 02:58:10,328 DEBUG [StoreOpener-1a1069b4442f7236a13b51c4da18e518-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2 2023-02-08 02:58:10,328 INFO [StoreOpener-1a1069b4442f7236a13b51c4da18e518-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a1069b4442f7236a13b51c4da18e518 columnFamilyName family2 2023-02-08 02:58:10,329 INFO [StoreOpener-1a1069b4442f7236a13b51c4da18e518-1] regionserver.HStore(310): Store=1a1069b4442f7236a13b51c4da18e518/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:58:10,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518 2023-02-08 02:58:10,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518 2023-02-08 02:58:10,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 02:58:10,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 1a1069b4442f7236a13b51c4da18e518 2023-02-08 02:58:10,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:58:10,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 1a1069b4442f7236a13b51c4da18e518; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71621328, jitterRate=0.06724095344543457}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 02:58:10,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 1a1069b4442f7236a13b51c4da18e518: Running coprocessor pre-open hook at 1675825090299Writing region info on filesystem at 1675825090299Initializing all the Stores at 1675825090301 (+2 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10l\xD05zL\xEB\x8Em\xF5\x89\xA3j\x9A\xD9m\xD6"\x10:\xD1`?\xDB?\xAB\xFDO!\x8Ck>\x11\x18\xE5*\x10-_\xD7\xB3\x88\xD8B%;*F\xBA\x0F\xB8\x02\x802\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825090301Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825090302 (+1 ms)Cleaning up temporary data from old regions at 1675825090330 (+28 ms)Cleaning up detritus from prior splits at 1675825090330Running coprocessor post-open hooks at 1675825090333 (+3 ms)Region opened successfully at 1675825090333 2023-02-08 02:58:10,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518., pid=122, masterSystemTime=1675825090293 2023-02-08 02:58:10,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:10,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:10,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:10,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c9c0e8bea9bed94731a60f71dbfa6b79, NAME => 'testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79.', STARTKEY => '', ENDKEY => '1'} 2023-02-08 02:58:10,335 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=1a1069b4442f7236a13b51c4da18e518, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:10,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin c9c0e8bea9bed94731a60f71dbfa6b79 2023-02-08 02:58:10,336 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1675825090335"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675825090335"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675825090335"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675825090335"}]},"ts":"1675825090335"} 2023-02-08 02:58:10,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:58:10,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for c9c0e8bea9bed94731a60f71dbfa6b79 2023-02-08 02:58:10,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for c9c0e8bea9bed94731a60f71dbfa6b79 2023-02-08 02:58:10,338 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=118 2023-02-08 02:58:10,338 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=118, state=SUCCESS; OpenRegionProcedure 1a1069b4442f7236a13b51c4da18e518, server=jenkins-hbase12.apache.org,44577,1675824910652 in 193 msec 2023-02-08 02:58:10,338 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1a1069b4442f7236a13b51c4da18e518, ASSIGN in 361 msec 2023-02-08 02:58:10,355 INFO [StoreOpener-c9c0e8bea9bed94731a60f71dbfa6b79-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c9c0e8bea9bed94731a60f71dbfa6b79 2023-02-08 02:58:10,356 DEBUG [StoreOpener-c9c0e8bea9bed94731a60f71dbfa6b79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1 2023-02-08 02:58:10,357 DEBUG [StoreOpener-c9c0e8bea9bed94731a60f71dbfa6b79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1 2023-02-08 02:58:10,357 INFO [StoreOpener-c9c0e8bea9bed94731a60f71dbfa6b79-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9c0e8bea9bed94731a60f71dbfa6b79 columnFamilyName family1 2023-02-08 02:58:10,358 INFO [StoreOpener-c9c0e8bea9bed94731a60f71dbfa6b79-1] regionserver.HStore(310): Store=c9c0e8bea9bed94731a60f71dbfa6b79/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:58:10,358 INFO [StoreOpener-c9c0e8bea9bed94731a60f71dbfa6b79-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c9c0e8bea9bed94731a60f71dbfa6b79 2023-02-08 02:58:10,359 DEBUG [StoreOpener-c9c0e8bea9bed94731a60f71dbfa6b79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2 2023-02-08 02:58:10,359 DEBUG [StoreOpener-c9c0e8bea9bed94731a60f71dbfa6b79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2 2023-02-08 02:58:10,359 INFO [StoreOpener-c9c0e8bea9bed94731a60f71dbfa6b79-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9c0e8bea9bed94731a60f71dbfa6b79 columnFamilyName family2 2023-02-08 02:58:10,360 INFO [StoreOpener-c9c0e8bea9bed94731a60f71dbfa6b79-1] regionserver.HStore(310): Store=c9c0e8bea9bed94731a60f71dbfa6b79/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:58:10,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79 2023-02-08 02:58:10,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79 2023-02-08 02:58:10,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 02:58:10,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for c9c0e8bea9bed94731a60f71dbfa6b79 2023-02-08 02:58:10,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:58:10,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened c9c0e8bea9bed94731a60f71dbfa6b79; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59872638, jitterRate=-0.10782817006111145}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 02:58:10,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for c9c0e8bea9bed94731a60f71dbfa6b79: Running coprocessor pre-open hook at 1675825090336Writing region info on filesystem at 1675825090336Initializing all the Stores at 1675825090336Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10l\xD05zL\xEB\x8Em\xF5\x89\xA3j\x9A\xD9m\xD6"\x10:\xD1`?\xDB?\xAB\xFDO!\x8Ck>\x11\x18\xE5*\x10-_\xD7\xB3\x88\xD8B%;*F\xBA\x0F\xB8\x02\x802\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825090336Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825090336Cleaning up temporary data from old regions at 1675825090361 (+25 ms)Cleaning up detritus from prior splits at 1675825090361Running coprocessor post-open hooks at 1675825090364 (+3 ms)Region opened successfully at 1675825090364 2023-02-08 02:58:10,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79., pid=120, masterSystemTime=1675825090293 2023-02-08 02:58:10,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:10,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:10,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:10,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fe25389ddac66aa7aadc2e3f393d5632, NAME => 'testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632.', STARTKEY => '2', ENDKEY => ''} 2023-02-08 02:58:10,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin fe25389ddac66aa7aadc2e3f393d5632 2023-02-08 02:58:10,366 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=c9c0e8bea9bed94731a60f71dbfa6b79, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:10,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 02:58:10,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for fe25389ddac66aa7aadc2e3f393d5632 2023-02-08 02:58:10,367 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675825090366"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675825090366"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675825090366"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675825090366"}]},"ts":"1675825090366"} 2023-02-08 02:58:10,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for fe25389ddac66aa7aadc2e3f393d5632 2023-02-08 02:58:10,369 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=117 2023-02-08 02:58:10,369 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure c9c0e8bea9bed94731a60f71dbfa6b79, server=jenkins-hbase12.apache.org,44577,1675824910652 in 227 msec 2023-02-08 02:58:10,370 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c9c0e8bea9bed94731a60f71dbfa6b79, ASSIGN in 392 msec 2023-02-08 02:58:10,386 INFO [StoreOpener-fe25389ddac66aa7aadc2e3f393d5632-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fe25389ddac66aa7aadc2e3f393d5632 2023-02-08 02:58:10,388 DEBUG [StoreOpener-fe25389ddac66aa7aadc2e3f393d5632-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1 2023-02-08 02:58:10,388 DEBUG [StoreOpener-fe25389ddac66aa7aadc2e3f393d5632-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1 2023-02-08 02:58:10,388 INFO [StoreOpener-fe25389ddac66aa7aadc2e3f393d5632-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe25389ddac66aa7aadc2e3f393d5632 columnFamilyName family1 2023-02-08 02:58:10,389 INFO [StoreOpener-fe25389ddac66aa7aadc2e3f393d5632-1] regionserver.HStore(310): Store=fe25389ddac66aa7aadc2e3f393d5632/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:58:10,389 INFO [StoreOpener-fe25389ddac66aa7aadc2e3f393d5632-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region fe25389ddac66aa7aadc2e3f393d5632 2023-02-08 02:58:10,390 DEBUG [StoreOpener-fe25389ddac66aa7aadc2e3f393d5632-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2 2023-02-08 02:58:10,390 DEBUG [StoreOpener-fe25389ddac66aa7aadc2e3f393d5632-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2 2023-02-08 02:58:10,390 INFO [StoreOpener-fe25389ddac66aa7aadc2e3f393d5632-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe25389ddac66aa7aadc2e3f393d5632 columnFamilyName family2 2023-02-08 02:58:10,391 INFO [StoreOpener-fe25389ddac66aa7aadc2e3f393d5632-1] regionserver.HStore(310): Store=fe25389ddac66aa7aadc2e3f393d5632/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 02:58:10,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632 2023-02-08 02:58:10,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632 2023-02-08 02:58:10,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 02:58:10,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for fe25389ddac66aa7aadc2e3f393d5632 2023-02-08 02:58:10,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 02:58:10,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened fe25389ddac66aa7aadc2e3f393d5632; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65623681, jitterRate=-0.022130951285362244}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 02:58:10,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for fe25389ddac66aa7aadc2e3f393d5632: Running coprocessor pre-open hook at 1675825090367Writing region info on filesystem at 1675825090367Initializing all the Stores at 1675825090367Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10l\xD05zL\xEB\x8Em\xF5\x89\xA3j\x9A\xD9m\xD6"\x10:\xD1`?\xDB?\xAB\xFDO!\x8Ck>\x11\x18\xE5*\x10-_\xD7\xB3\x88\xD8B%;*F\xBA\x0F\xB8\x02\x802\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825090367Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675825090368 (+1 ms)Cleaning up temporary data from old regions at 1675825090392 (+24 ms)Cleaning up detritus from prior splits at 1675825090392Running coprocessor post-open hooks at 1675825090395 (+3 ms)Region opened successfully at 1675825090395 2023-02-08 02:58:10,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632., pid=121, masterSystemTime=1675825090293 2023-02-08 02:58:10,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:10,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:10,397 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=fe25389ddac66aa7aadc2e3f393d5632, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:10,397 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675825090396"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675825090396"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675825090396"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675825090396"}]},"ts":"1675825090396"} 2023-02-08 02:58:10,398 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=119 2023-02-08 02:58:10,399 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=119, state=SUCCESS; OpenRegionProcedure fe25389ddac66aa7aadc2e3f393d5632, server=jenkins-hbase12.apache.org,44577,1675824910652 in 255 msec 2023-02-08 02:58:10,400 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=119, resume processing ppid=116 2023-02-08 02:58:10,400 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=fe25389ddac66aa7aadc2e3f393d5632, ASSIGN in 422 msec 2023-02-08 02:58:10,400 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 02:58:10,400 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675825090400"}]},"ts":"1675825090400"} 2023-02-08 02:58:10,401 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-02-08 02:58:10,448 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 02:58:10,450 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.4900 sec 2023-02-08 02:58:11,070 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:11,070 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:11,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-08 02:58:11,073 INFO [Listener at localhost.localdomain/44017] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-02-08 02:58:11,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:58:11,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:58:11,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:58:11,086 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:11,086 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:11,087 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:58:11,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-08 02:58:11,088 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-08 02:58:11,088 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:58:11,088 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-08 02:58:11,088 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-08 02:58:11,089 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:11,089 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:11,141 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:11,141 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:11,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:11,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:11,142 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:11,142 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:58:11,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:11,143 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:11,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:58:11,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:11,144 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-08 02:58:11,144 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-08 02:58:11,144 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-08 02:58:11,145 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:58:11,145 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-08 02:58:11,145 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:11,145 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. started... 2023-02-08 02:58:11,145 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:11,145 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 02:58:11,145 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:11,146 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fe25389ddac66aa7aadc2e3f393d5632 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-08 02:58:11,146 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. started... 2023-02-08 02:58:11,146 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:58:11,145 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. started... 2023-02-08 02:58:11,147 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing c9c0e8bea9bed94731a60f71dbfa6b79 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-08 02:58:11,148 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1a1069b4442f7236a13b51c4da18e518 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-08 02:58:11,600 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208e5f38eeefca244abbe9022d92a6b6893 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230208e5f38eeefca244abbe9022d92a6b6893 2023-02-08 02:58:11,609 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302084c2080d0a64e4ee8bd5fe4480cf356e0 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302084c2080d0a64e4ee8bd5fe4480cf356e0 2023-02-08 02:58:11,610 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302085fe4c884cecf405ba0842e898e296c71 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302085fe4c884cecf405ba0842e898e296c71 2023-02-08 02:58:12,018 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp/family1/db7d1c392d0843058f153bce14590c1c 2023-02-08 02:58:12,027 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp/family1/40f52b922f6342138d1d8d6c533344d4 2023-02-08 02:58:12,027 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp/family1/0388146f423a4db9a121616f8f460c59 2023-02-08 02:58:12,465 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020863c1e708a9d3424998d7fce090703655 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023020863c1e708a9d3424998d7fce090703655 2023-02-08 02:58:12,465 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208e00d3bd718bb42e48ca4f4619aa7d41d to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230208e00d3bd718bb42e48ca4f4619aa7d41d 2023-02-08 02:58:12,465 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208303fd6ad07d640c6ad23e606f9c18de8 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230208303fd6ad07d640c6ad23e606f9c18de8 2023-02-08 02:58:12,869 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp/family2/df781304b0a642d7a383517818e871f2 2023-02-08 02:58:12,870 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp/family2/989c603dd34e4c3e803b77f96d67f0c7 2023-02-08 02:58:12,870 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp/family2/28dff81a8e8c4c23a02ffc16c6287675 2023-02-08 02:58:12,878 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp/family1/40f52b922f6342138d1d8d6c533344d4 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/40f52b922f6342138d1d8d6c533344d4 2023-02-08 02:58:12,878 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp/family1/0388146f423a4db9a121616f8f460c59 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/0388146f423a4db9a121616f8f460c59 2023-02-08 02:58:12,879 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp/family1/db7d1c392d0843058f153bce14590c1c as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/db7d1c392d0843058f153bce14590c1c 2023-02-08 02:58:12,898 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/0388146f423a4db9a121616f8f460c59, entries=4, sequenceid=5, filesize=5.5 K 2023-02-08 02:58:12,899 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp/family2/28dff81a8e8c4c23a02ffc16c6287675 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/28dff81a8e8c4c23a02ffc16c6287675 2023-02-08 02:58:12,902 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/28dff81a8e8c4c23a02ffc16c6287675, entries=2, sequenceid=5, filesize=5.1 K 2023-02-08 02:58:12,903 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 1a1069b4442f7236a13b51c4da18e518 in 1755ms, sequenceid=5, compaction requested=false 2023-02-08 02:58:12,903 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-02-08 02:58:12,903 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1a1069b4442f7236a13b51c4da18e518: 2023-02-08 02:58:12,903 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:12,904 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 02:58:12,905 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/40f52b922f6342138d1d8d6c533344d4, entries=4, sequenceid=5, filesize=5.5 K 2023-02-08 02:58:12,905 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/db7d1c392d0843058f153bce14590c1c, entries=4, sequenceid=5, filesize=5.5 K 2023-02-08 02:58:12,906 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp/family2/df781304b0a642d7a383517818e871f2 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/df781304b0a642d7a383517818e871f2 2023-02-08 02:58:12,906 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp/family2/989c603dd34e4c3e803b77f96d67f0c7 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/989c603dd34e4c3e803b77f96d67f0c7 2023-02-08 02:58:12,909 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/989c603dd34e4c3e803b77f96d67f0c7, entries=2, sequenceid=5, filesize=5.1 K 2023-02-08 02:58:12,909 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/df781304b0a642d7a383517818e871f2, entries=2, sequenceid=5, filesize=5.1 K 2023-02-08 02:58:12,910 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c9c0e8bea9bed94731a60f71dbfa6b79 in 1763ms, sequenceid=5, compaction requested=false 2023-02-08 02:58:12,910 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for fe25389ddac66aa7aadc2e3f393d5632 in 1764ms, sequenceid=5, compaction requested=false 2023-02-08 02:58:12,911 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c9c0e8bea9bed94731a60f71dbfa6b79: 2023-02-08 02:58:12,911 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fe25389ddac66aa7aadc2e3f393d5632: 2023-02-08 02:58:12,911 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:12,911 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:12,911 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 02:58:12,911 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 02:58:12,911 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 02:58:12,911 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:12,911 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-08 02:58:12,911 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-08 02:58:12,962 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:12,962 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:12,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:12,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:12,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:12,963 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:12,963 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:58:12,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:12,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:12,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:12,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:12,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:12,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-08 02:58:12,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1249a074[Count = 0] remaining members to acquire global barrier 2023-02-08 02:58:12,968 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-08 02:58:12,968 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:12,973 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:12,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:12,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:12,973 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-08 02:58:12,974 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-08 02:58:12,974 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:58:12,974 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:12,974 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:58:12,984 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-08 02:58:12,984 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:12,984 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-08 02:58:12,984 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:12,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:12,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:12,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:12,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:12,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:12,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:12,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:12,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:12,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:12,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:12,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:58:12,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-08 02:58:12,994 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-08 02:58:12,994 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:58:12,995 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:58:12,995 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-08 02:58:12,995 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:58:13,004 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:13,005 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:13,004 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:13,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:13,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:13,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:13,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:13,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:13,006 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:13,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:13,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:13,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:13,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:13,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:13,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:13,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:13,007 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:13,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:13,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:13,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:13,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:13,015 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:13,015 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:13,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:13,015 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-08 02:58:13,015 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:58:13,015 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:13,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-08 02:58:13,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:13,015 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:13,015 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:13,015 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-08 02:58:13,015 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:13,015 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:58:13,015 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:13,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:13,016 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:13,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:13,016 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:13,016 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:13,116 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:58:13,116 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:13,116 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:13,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:58:13,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:58:13,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:58:13,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:58:13,123 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:13,123 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:13,124 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:58:13,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-08 02:58:13,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-08 02:58:13,127 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-08 02:58:13,127 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:58:13,127 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-08 02:58:13,127 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-08 02:58:13,128 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:13,128 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:13,131 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:13,131 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:13,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:13,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:13,131 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:13,131 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:58:13,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:13,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:13,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:58:13,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:13,133 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-08 02:58:13,133 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-08 02:58:13,133 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-08 02:58:13,133 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-08 02:58:13,133 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:58:13,133 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-08 02:58:13,134 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:13,134 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. started... 2023-02-08 02:58:13,134 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 02:58:13,134 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:13,134 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fe25389ddac66aa7aadc2e3f393d5632 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-08 02:58:13,134 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:13,134 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. started... 2023-02-08 02:58:13,134 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:58:13,134 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing c9c0e8bea9bed94731a60f71dbfa6b79 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-08 02:58:13,134 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. started... 2023-02-08 02:58:13,135 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1a1069b4442f7236a13b51c4da18e518 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-08 02:58:13,160 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 02:58:13,160 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ee8f511 to 127.0.0.1:49602 2023-02-08 02:58:13,160 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:58:13,160 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 02:58:13,161 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1201e9c1 to 127.0.0.1:49602 2023-02-08 02:58:13,161 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:58:13,599 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302088e1d8950157e442dab08011d7c6ca956 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302088e1d8950157e442dab08011d7c6ca956 2023-02-08 02:58:13,599 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208bfbe9c18ea4342b19b170769c196e35f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230208bfbe9c18ea4342b19b170769c196e35f 2023-02-08 02:58:13,599 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208b6e2e5fd89ec494a875a924e84224c69 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230208b6e2e5fd89ec494a875a924e84224c69 2023-02-08 02:58:13,614 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp/family1/221fff2fef6c4ca4886116b466e5a295 2023-02-08 02:58:14,023 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp/family1/29e24d4aff8e40f788e7b35e52ea989c 2023-02-08 02:58:14,028 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp/family1/064a974478424d628203f916d5b5cb5f 2023-02-08 02:58:14,056 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208a3ac9f427ebb4fe5a0b16b8fab941662 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230208a3ac9f427ebb4fe5a0b16b8fab941662 2023-02-08 02:58:14,460 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp/family2/249a037d4fcd4b9ea02ba58978ee55de 2023-02-08 02:58:14,463 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020898c92991066748a8879f655997417170 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023020898c92991066748a8879f655997417170 2023-02-08 02:58:14,463 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208a389571766244d978558ab970e643041 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230208a389571766244d978558ab970e643041 2023-02-08 02:58:14,465 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp/family1/221fff2fef6c4ca4886116b466e5a295 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/221fff2fef6c4ca4886116b466e5a295 2023-02-08 02:58:14,468 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp/family2/d7452997fc3b4fbca146be6852b53da2 2023-02-08 02:58:14,472 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp/family1/29e24d4aff8e40f788e7b35e52ea989c as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/29e24d4aff8e40f788e7b35e52ea989c 2023-02-08 02:58:14,488 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/221fff2fef6c4ca4886116b466e5a295, entries=4, sequenceid=9, filesize=5.5 K 2023-02-08 02:58:14,489 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp/family2/249a037d4fcd4b9ea02ba58978ee55de as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/249a037d4fcd4b9ea02ba58978ee55de 2023-02-08 02:58:14,493 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/249a037d4fcd4b9ea02ba58978ee55de, entries=2, sequenceid=9, filesize=5.1 K 2023-02-08 02:58:14,493 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/29e24d4aff8e40f788e7b35e52ea989c, entries=4, sequenceid=9, filesize=5.5 K 2023-02-08 02:58:14,493 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1a1069b4442f7236a13b51c4da18e518 in 1358ms, sequenceid=9, compaction requested=false 2023-02-08 02:58:14,494 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp/family2/d7452997fc3b4fbca146be6852b53da2 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/d7452997fc3b4fbca146be6852b53da2 2023-02-08 02:58:14,494 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1a1069b4442f7236a13b51c4da18e518: 2023-02-08 02:58:14,494 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:14,494 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 02:58:14,496 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/d7452997fc3b4fbca146be6852b53da2, entries=2, sequenceid=9, filesize=5.1 K 2023-02-08 02:58:14,497 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c9c0e8bea9bed94731a60f71dbfa6b79 in 1363ms, sequenceid=9, compaction requested=false 2023-02-08 02:58:14,497 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c9c0e8bea9bed94731a60f71dbfa6b79: 2023-02-08 02:58:14,497 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:14,497 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 02:58:14,869 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp/family2/cf266c99f2014f318dd7e80a6c424e0f 2023-02-08 02:58:14,872 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp/family1/064a974478424d628203f916d5b5cb5f as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/064a974478424d628203f916d5b5cb5f 2023-02-08 02:58:14,894 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/064a974478424d628203f916d5b5cb5f, entries=4, sequenceid=9, filesize=5.5 K 2023-02-08 02:58:14,895 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp/family2/cf266c99f2014f318dd7e80a6c424e0f as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/cf266c99f2014f318dd7e80a6c424e0f 2023-02-08 02:58:14,899 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/cf266c99f2014f318dd7e80a6c424e0f, entries=2, sequenceid=9, filesize=5.1 K 2023-02-08 02:58:14,899 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for fe25389ddac66aa7aadc2e3f393d5632 in 1765ms, sequenceid=9, compaction requested=false 2023-02-08 02:58:14,900 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fe25389ddac66aa7aadc2e3f393d5632: 2023-02-08 02:58:14,900 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:14,900 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 02:58:14,900 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 02:58:14,900 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:14,900 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-08 02:58:14,900 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-08 02:58:14,909 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:14,910 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:14,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:14,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:14,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:14,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:14,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:14,910 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:14,910 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:58:14,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:14,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:14,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:14,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-08 02:58:14,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2570cf3d[Count = 0] remaining members to acquire global barrier 2023-02-08 02:58:14,911 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-08 02:58:14,911 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:14,931 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:14,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:14,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:14,931 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-08 02:58:14,931 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-08 02:58:14,931 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:58:14,931 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:14,931 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:58:14,941 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-08 02:58:14,941 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:14,941 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-08 02:58:14,941 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:14,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:14,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:14,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:14,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:14,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:14,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:14,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:14,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:14,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:14,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:14,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:58:14,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-08 02:58:14,944 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-08 02:58:14,944 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:58:14,944 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:58:14,944 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-08 02:58:14,944 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:58:14,952 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:14,952 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:14,952 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:14,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:14,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:14,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:14,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:14,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:14,952 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:14,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:14,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:14,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:14,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:14,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:14,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:14,953 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:14,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:14,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:14,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:14,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:14,962 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:14,962 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:14,962 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:14,962 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-08 02:58:14,962 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:58:14,962 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:14,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:14,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:14,962 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:14,962 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:14,963 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-08 02:58:14,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-08 02:58:14,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:14,963 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:14,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:14,963 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:58:14,963 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:14,963 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:14,963 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:15,063 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:58:15,063 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:15,063 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:15,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:58:15,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:58:15,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:58:15,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:58:15,068 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:15,068 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:15,069 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:58:15,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-08 02:58:15,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-08 02:58:15,072 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-08 02:58:15,072 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:58:15,072 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-08 02:58:15,072 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-08 02:58:15,072 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:15,073 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:15,078 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:15,078 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:15,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:15,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:15,079 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:15,079 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:58:15,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:15,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:15,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:58:15,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:15,081 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-08 02:58:15,081 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-08 02:58:15,081 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-08 02:58:15,081 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-08 02:58:15,081 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:58:15,082 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-08 02:58:15,082 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:15,082 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. started... 2023-02-08 02:58:15,082 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:15,082 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. started... 2023-02-08 02:58:15,082 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:15,082 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1a1069b4442f7236a13b51c4da18e518 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-08 02:58:15,082 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 02:58:15,083 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:58:15,082 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. started... 2023-02-08 02:58:15,082 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fe25389ddac66aa7aadc2e3f393d5632 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-08 02:58:15,083 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing c9c0e8bea9bed94731a60f71dbfa6b79 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-08 02:58:15,119 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208e436c55e1ea148d399bf2accdb0b9368 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230208e436c55e1ea148d399bf2accdb0b9368 2023-02-08 02:58:15,121 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302081aa7af1337b149588182ec6110c37cb3 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302081aa7af1337b149588182ec6110c37cb3 2023-02-08 02:58:15,134 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp/family1/cc4825597b9741938ecb6800c3b2173e 2023-02-08 02:58:15,532 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302086d5483d8eec4449581dbcead317841de to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302086d5483d8eec4449581dbcead317841de 2023-02-08 02:58:15,541 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp/family1/52a15f5bfa9e4130aa79c90f5717ae21 2023-02-08 02:58:15,563 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302082d3ddc201bf843dfaec8a10ef7bb8f87 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302082d3ddc201bf843dfaec8a10ef7bb8f87 2023-02-08 02:58:15,838 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 02:58:15,945 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp/family1/5bb96b17b83d47b8b1f5d5c0db8f142b 2023-02-08 02:58:15,972 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp/family2/f3614b8ff70746f5b7c7b777a1f522fa 2023-02-08 02:58:15,975 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp/family1/cc4825597b9741938ecb6800c3b2173e as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/cc4825597b9741938ecb6800c3b2173e 2023-02-08 02:58:15,982 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208180d513621464928a28eb8cb7346cf9f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230208180d513621464928a28eb8cb7346cf9f 2023-02-08 02:58:15,986 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp/family2/7bbcc23a5afe4dc9979404977c51df05 2023-02-08 02:58:15,989 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp/family1/52a15f5bfa9e4130aa79c90f5717ae21 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/52a15f5bfa9e4130aa79c90f5717ae21 2023-02-08 02:58:15,999 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/cc4825597b9741938ecb6800c3b2173e, entries=4, sequenceid=13, filesize=5.5 K 2023-02-08 02:58:15,999 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp/family2/f3614b8ff70746f5b7c7b777a1f522fa as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/f3614b8ff70746f5b7c7b777a1f522fa 2023-02-08 02:58:16,002 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/f3614b8ff70746f5b7c7b777a1f522fa, entries=2, sequenceid=13, filesize=5.1 K 2023-02-08 02:58:16,003 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 1a1069b4442f7236a13b51c4da18e518 in 921ms, sequenceid=13, compaction requested=true 2023-02-08 02:58:16,003 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1a1069b4442f7236a13b51c4da18e518: 2023-02-08 02:58:16,003 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:16,003 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 02:58:16,010 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/52a15f5bfa9e4130aa79c90f5717ae21, entries=4, sequenceid=13, filesize=5.5 K 2023-02-08 02:58:16,010 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp/family2/7bbcc23a5afe4dc9979404977c51df05 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/7bbcc23a5afe4dc9979404977c51df05 2023-02-08 02:58:16,014 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/7bbcc23a5afe4dc9979404977c51df05, entries=2, sequenceid=13, filesize=5.1 K 2023-02-08 02:58:16,015 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c9c0e8bea9bed94731a60f71dbfa6b79 in 932ms, sequenceid=13, compaction requested=true 2023-02-08 02:58:16,015 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c9c0e8bea9bed94731a60f71dbfa6b79: 2023-02-08 02:58:16,015 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:16,015 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 02:58:16,376 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208d496724d66b84497a144de7ed325d1ae to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230208d496724d66b84497a144de7ed325d1ae 2023-02-08 02:58:16,783 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp/family2/e3eb865a8b13466da1b039178efac0ec 2023-02-08 02:58:16,793 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp/family1/5bb96b17b83d47b8b1f5d5c0db8f142b as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/5bb96b17b83d47b8b1f5d5c0db8f142b 2023-02-08 02:58:16,820 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/5bb96b17b83d47b8b1f5d5c0db8f142b, entries=4, sequenceid=13, filesize=5.5 K 2023-02-08 02:58:16,821 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp/family2/e3eb865a8b13466da1b039178efac0ec as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/e3eb865a8b13466da1b039178efac0ec 2023-02-08 02:58:16,825 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/e3eb865a8b13466da1b039178efac0ec, entries=2, sequenceid=13, filesize=5.1 K 2023-02-08 02:58:16,825 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for fe25389ddac66aa7aadc2e3f393d5632 in 1743ms, sequenceid=13, compaction requested=true 2023-02-08 02:58:16,825 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fe25389ddac66aa7aadc2e3f393d5632: 2023-02-08 02:58:16,825 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:16,826 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 02:58:16,826 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 02:58:16,826 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:16,826 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-08 02:58:16,826 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-08 02:58:16,912 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:16,912 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:16,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:16,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:16,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:16,914 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:16,914 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:58:16,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:16,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:16,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:16,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-08 02:58:16,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f57fe3c[Count = 0] remaining members to acquire global barrier 2023-02-08 02:58:16,918 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-08 02:58:16,918 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:16,930 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:16,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:16,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:16,931 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-08 02:58:16,931 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-08 02:58:16,931 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:58:16,931 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:16,931 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:58:16,952 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-08 02:58:16,952 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:16,952 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:16,952 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-08 02:58:16,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:16,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:16,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:16,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:16,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:16,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:16,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:16,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:16,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:16,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:16,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:58:16,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-08 02:58:16,959 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-08 02:58:16,959 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:58:16,959 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:58:16,959 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-08 02:58:16,960 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:58:16,973 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:16,973 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:16,973 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:16,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:16,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:16,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:16,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:16,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:16,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:16,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:16,975 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:16,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:16,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:16,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:16,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:16,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:16,977 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:16,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:16,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:16,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:16,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:17,022 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:17,022 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:17,022 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:17,022 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-08 02:58:17,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-08 02:58:17,022 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:17,023 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:58:17,022 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:17,023 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:17,023 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:17,023 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:17,022 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:17,023 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-08 02:58:17,024 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:58:17,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:17,023 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:17,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:17,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:17,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:17,124 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:58:17,124 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:17,125 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:17,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:58:17,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:58:17,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:58:17,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 02:58:17,135 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:17,135 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:17,137 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:58:17,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-08 02:58:17,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-08 02:58:17,140 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-08 02:58:17,140 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:58:17,140 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-08 02:58:17,140 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-08 02:58:17,141 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:17,141 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:17,162 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:17,162 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:17,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:17,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:17,163 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:17,163 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:58:17,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:17,164 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:17,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:58:17,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:17,164 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-08 02:58:17,165 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-08 02:58:17,165 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-08 02:58:17,165 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-08 02:58:17,165 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:58:17,165 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-08 02:58:17,165 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:17,165 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. started... 2023-02-08 02:58:17,165 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 02:58:17,165 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:58:17,165 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:17,166 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. started... 2023-02-08 02:58:17,165 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fe25389ddac66aa7aadc2e3f393d5632 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-08 02:58:17,165 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:17,166 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. started... 2023-02-08 02:58:17,166 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1a1069b4442f7236a13b51c4da18e518 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-08 02:58:17,166 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing c9c0e8bea9bed94731a60f71dbfa6b79 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-08 02:58:17,246 DEBUG [regionserver/jenkins-hbase12:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-08 02:58:17,615 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020868a65b5f2feb48a3b3d01f376bbc6c19 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020868a65b5f2feb48a3b3d01f376bbc6c19 2023-02-08 02:58:17,615 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302083721b4b0661447a09179f806c6610e99 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302083721b4b0661447a09179f806c6610e99 2023-02-08 02:58:17,615 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302087c9ebe22a34143d09059f6a6ac8d53e8 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302087c9ebe22a34143d09059f6a6ac8d53e8 2023-02-08 02:58:17,628 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp/family1/accb4e7168e642bf9c565f7f49c87cda 2023-02-08 02:58:18,029 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp/family1/4c87541f6edc4d3db872c00103a22426 2023-02-08 02:58:18,030 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp/family1/223af425b2d346618891fe8e6cd4a62e 2023-02-08 02:58:18,055 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208a8cd19b36f264366a3f727c508388a3c to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230208a8cd19b36f264366a3f727c508388a3c 2023-02-08 02:58:18,461 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp/family2/c4994ff128c148b28f32dffd5095f3ff 2023-02-08 02:58:18,470 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208c06d7aed10d547c0bb4645abaef1c217 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230208c06d7aed10d547c0bb4645abaef1c217 2023-02-08 02:58:18,471 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp/family1/accb4e7168e642bf9c565f7f49c87cda as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/accb4e7168e642bf9c565f7f49c87cda 2023-02-08 02:58:18,471 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208963761eaff0542319b2b38a5e8c3786b to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230208963761eaff0542319b2b38a5e8c3786b 2023-02-08 02:58:18,493 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/accb4e7168e642bf9c565f7f49c87cda, entries=4, sequenceid=17, filesize=5.5 K 2023-02-08 02:58:18,494 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp/family2/c4994ff128c148b28f32dffd5095f3ff as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/c4994ff128c148b28f32dffd5095f3ff 2023-02-08 02:58:18,498 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/c4994ff128c148b28f32dffd5095f3ff, entries=2, sequenceid=17, filesize=5.1 K 2023-02-08 02:58:18,499 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 1a1069b4442f7236a13b51c4da18e518 in 1332ms, sequenceid=17, compaction requested=true 2023-02-08 02:58:18,499 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1a1069b4442f7236a13b51c4da18e518: 2023-02-08 02:58:18,499 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:18,499 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 02:58:18,876 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp/family2/e767be0cae32449b947f1e0d83029418 2023-02-08 02:58:18,878 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp/family2/62f1a5ecd52e4499a4539cc07d5190f8 2023-02-08 02:58:18,885 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp/family1/223af425b2d346618891fe8e6cd4a62e as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/223af425b2d346618891fe8e6cd4a62e 2023-02-08 02:58:18,886 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp/family1/4c87541f6edc4d3db872c00103a22426 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/4c87541f6edc4d3db872c00103a22426 2023-02-08 02:58:18,911 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/4c87541f6edc4d3db872c00103a22426, entries=4, sequenceid=17, filesize=5.5 K 2023-02-08 02:58:18,911 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/223af425b2d346618891fe8e6cd4a62e, entries=4, sequenceid=17, filesize=5.5 K 2023-02-08 02:58:18,912 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp/family2/62f1a5ecd52e4499a4539cc07d5190f8 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/62f1a5ecd52e4499a4539cc07d5190f8 2023-02-08 02:58:18,912 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp/family2/e767be0cae32449b947f1e0d83029418 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/e767be0cae32449b947f1e0d83029418 2023-02-08 02:58:18,915 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/62f1a5ecd52e4499a4539cc07d5190f8, entries=2, sequenceid=17, filesize=5.1 K 2023-02-08 02:58:18,916 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for fe25389ddac66aa7aadc2e3f393d5632 in 1751ms, sequenceid=17, compaction requested=true 2023-02-08 02:58:18,916 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fe25389ddac66aa7aadc2e3f393d5632: 2023-02-08 02:58:18,916 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:18,916 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 02:58:18,920 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/e767be0cae32449b947f1e0d83029418, entries=2, sequenceid=17, filesize=5.1 K 2023-02-08 02:58:18,921 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c9c0e8bea9bed94731a60f71dbfa6b79 in 1755ms, sequenceid=17, compaction requested=true 2023-02-08 02:58:18,921 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c9c0e8bea9bed94731a60f71dbfa6b79: 2023-02-08 02:58:18,921 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:18,921 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 02:58:18,921 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 02:58:18,921 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:18,921 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-08 02:58:18,921 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-08 02:58:18,930 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:18,930 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:18,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:18,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:18,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:18,931 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:18,931 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:58:18,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:18,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:18,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:18,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:18,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:18,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-08 02:58:18,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f0e4d04[Count = 0] remaining members to acquire global barrier 2023-02-08 02:58:18,932 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-08 02:58:18,932 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:18,941 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:18,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:18,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:18,941 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-08 02:58:18,941 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-08 02:58:18,941 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:58:18,941 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:18,941 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:58:18,951 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-08 02:58:18,951 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:18,951 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:18,952 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-08 02:58:18,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:18,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:18,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:18,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:18,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:18,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:18,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:18,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:18,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:18,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:18,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:58:18,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-08 02:58:18,955 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-08 02:58:18,955 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:58:18,955 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:58:18,955 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-08 02:58:18,955 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:58:18,962 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:18,962 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:18,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:18,962 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:18,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:18,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:18,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:18,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:18,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:18,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:18,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:18,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:18,963 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:18,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:18,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:18,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:18,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:18,965 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:18,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:18,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:18,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:18,972 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:18,972 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:18,972 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:18,973 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-08 02:58:18,972 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:18,973 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:18,973 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:18,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:18,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:18,972 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-08 02:58:18,973 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:58:18,972 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:18,973 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:18,973 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:18,973 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:18,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:18,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:18,973 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-08 02:58:18,973 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:58:19,074 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:58:19,074 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:19,074 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:19,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:58:19,086 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 02:58:19,096 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 02:58:19,106 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 02:58:19,107 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 02:58:19,180 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:19,180 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:19,180 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 02:58:19,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-08 02:58:19,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-08 02:58:19,181 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-08 02:58:19,181 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:58:19,181 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-08 02:58:19,182 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-08 02:58:19,182 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:19,182 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:19,223 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:19,223 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:19,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:19,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:19,224 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:19,224 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 02:58:19,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:19,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:19,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 02:58:19,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:19,224 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-08 02:58:19,224 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-08 02:58:19,224 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-08 02:58:19,225 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-08 02:58:19,225 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 02:58:19,225 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-08 02:58:19,225 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:19,225 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. started... 2023-02-08 02:58:19,225 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:19,225 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. started... 2023-02-08 02:58:19,225 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fe25389ddac66aa7aadc2e3f393d5632 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-08 02:58:19,225 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1a1069b4442f7236a13b51c4da18e518 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-08 02:58:19,227 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 02:58:19,227 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 02:58:19,227 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:19,227 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. started... 2023-02-08 02:58:19,227 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing c9c0e8bea9bed94731a60f71dbfa6b79 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-08 02:58:19,660 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp/family1/40ca91a7e8b54bec82d406df60986cbf 2023-02-08 02:58:19,682 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 40ca91a7e8b54bec82d406df60986cbf 2023-02-08 02:58:20,070 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp/family1/a5e83fc0f2744fbda9a8cfc3bc5c57ae 2023-02-08 02:58:20,070 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp/family1/877260fadcd44f2e8780760f7ff39fac 2023-02-08 02:58:20,102 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 877260fadcd44f2e8780760f7ff39fac 2023-02-08 02:58:20,102 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a5e83fc0f2744fbda9a8cfc3bc5c57ae 2023-02-08 02:58:20,493 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp/family2/a0cbe9fd1d1449fb9be52e3cb0179048 2023-02-08 02:58:20,496 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a0cbe9fd1d1449fb9be52e3cb0179048 2023-02-08 02:58:20,496 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp/family1/40ca91a7e8b54bec82d406df60986cbf as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/40ca91a7e8b54bec82d406df60986cbf 2023-02-08 02:58:20,519 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 40ca91a7e8b54bec82d406df60986cbf 2023-02-08 02:58:20,519 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/40ca91a7e8b54bec82d406df60986cbf, entries=3, sequenceid=23, filesize=5.2 K 2023-02-08 02:58:20,520 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp/family2/a0cbe9fd1d1449fb9be52e3cb0179048 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/a0cbe9fd1d1449fb9be52e3cb0179048 2023-02-08 02:58:20,523 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a0cbe9fd1d1449fb9be52e3cb0179048 2023-02-08 02:58:20,523 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/a0cbe9fd1d1449fb9be52e3cb0179048, entries=1, sequenceid=23, filesize=5.0 K 2023-02-08 02:58:20,524 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 1a1069b4442f7236a13b51c4da18e518 in 1299ms, sequenceid=23, compaction requested=true 2023-02-08 02:58:20,524 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1a1069b4442f7236a13b51c4da18e518: 2023-02-08 02:58:20,524 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:20,524 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 02:58:20,915 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp/family2/29a7e00d7846409f94e8f50c700ad06f 2023-02-08 02:58:20,915 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp/family2/fbf9b2becaf847c8ba79e7fda28fb9d7 2023-02-08 02:58:20,921 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 29a7e00d7846409f94e8f50c700ad06f 2023-02-08 02:58:20,922 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fbf9b2becaf847c8ba79e7fda28fb9d7 2023-02-08 02:58:20,923 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp/family1/a5e83fc0f2744fbda9a8cfc3bc5c57ae as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/a5e83fc0f2744fbda9a8cfc3bc5c57ae 2023-02-08 02:58:20,923 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp/family1/877260fadcd44f2e8780760f7ff39fac as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/877260fadcd44f2e8780760f7ff39fac 2023-02-08 02:58:20,945 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 877260fadcd44f2e8780760f7ff39fac 2023-02-08 02:58:20,945 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a5e83fc0f2744fbda9a8cfc3bc5c57ae 2023-02-08 02:58:20,945 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/877260fadcd44f2e8780760f7ff39fac, entries=3, sequenceid=23, filesize=5.2 K 2023-02-08 02:58:20,945 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/a5e83fc0f2744fbda9a8cfc3bc5c57ae, entries=3, sequenceid=23, filesize=5.2 K 2023-02-08 02:58:20,946 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp/family2/29a7e00d7846409f94e8f50c700ad06f as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/29a7e00d7846409f94e8f50c700ad06f 2023-02-08 02:58:20,946 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp/family2/fbf9b2becaf847c8ba79e7fda28fb9d7 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/fbf9b2becaf847c8ba79e7fda28fb9d7 2023-02-08 02:58:20,948 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fbf9b2becaf847c8ba79e7fda28fb9d7 2023-02-08 02:58:20,948 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 29a7e00d7846409f94e8f50c700ad06f 2023-02-08 02:58:20,949 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/fbf9b2becaf847c8ba79e7fda28fb9d7, entries=1, sequenceid=23, filesize=5.0 K 2023-02-08 02:58:20,949 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/29a7e00d7846409f94e8f50c700ad06f, entries=1, sequenceid=23, filesize=5.0 K 2023-02-08 02:58:20,949 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for fe25389ddac66aa7aadc2e3f393d5632 in 1724ms, sequenceid=23, compaction requested=true 2023-02-08 02:58:20,949 INFO [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c9c0e8bea9bed94731a60f71dbfa6b79 in 1722ms, sequenceid=23, compaction requested=true 2023-02-08 02:58:20,949 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fe25389ddac66aa7aadc2e3f393d5632: 2023-02-08 02:58:20,949 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c9c0e8bea9bed94731a60f71dbfa6b79: 2023-02-08 02:58:20,949 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:20,949 DEBUG [rs(jenkins-hbase12.apache.org,44577,1675824910652)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:20,949 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 02:58:20,949 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 02:58:20,949 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 02:58:20,950 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:20,950 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-08 02:58:20,950 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-08 02:58:20,962 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:20,962 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:20,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:20,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:20,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:20,962 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:20,962 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 02:58:20,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:20,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:20,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:20,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:20,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:20,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,44577,1675824910652' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-08 02:58:20,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b1c91[Count = 0] remaining members to acquire global barrier 2023-02-08 02:58:20,964 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-08 02:58:20,964 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:20,972 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:20,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:20,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:20,972 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-08 02:58:20,973 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-08 02:58:20,973 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase12.apache.org,44577,1675824910652' in zk 2023-02-08 02:58:20,973 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:20,973 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 02:58:20,983 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:20,983 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-08 02:58:20,983 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:20,983 DEBUG [member: 'jenkins-hbase12.apache.org,44577,1675824910652' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-08 02:58:20,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:20,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:20,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:20,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:20,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:20,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:20,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:20,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:20,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:20,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:20,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase12.apache.org,44577,1675824910652': 2023-02-08 02:58:20,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,44577,1675824910652' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-08 02:58:20,990 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-08 02:58:20,990 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 02:58:20,990 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 02:58:20,990 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-08 02:58:20,990 INFO [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 02:58:21,004 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:21,004 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:21,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:21,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:21,004 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:21,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:21,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 02:58:21,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 02:58:21,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:21,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:21,005 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:21,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 02:58:21,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:21,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:21,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 02:58:21,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:21,008 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:21,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:21,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 02:58:21,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 02:58:21,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:21,014 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:21,014 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 02:58:21,015 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:21,015 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-08 02:58:21,015 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 02:58:21,015 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 02:58:21,015 DEBUG [(jenkins-hbase12.apache.org,43477,1675824909306)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 02:58:21,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 02:58:21,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 02:58:21,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-08 02:58:21,015 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 02:58:21,015 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-08 02:58:21,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 02:58:21,015 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:21,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 02:58:21,016 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 02:58:21,016 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:21,016 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 02:58:21,016 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 02:58:21,116 DEBUG [Listener at localhost.localdomain/44017] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 02:58:21,116 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:21,116 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:21,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43477] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 02:58:21,118 DEBUG [Listener at localhost.localdomain/44017] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 02:58:21,118 DEBUG [Listener at localhost.localdomain/44017] regionserver.HStore(1912): fe25389ddac66aa7aadc2e3f393d5632/family1 is initiating major compaction (all files) 2023-02-08 02:58:21,119 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 02:58:21,119 INFO [Listener at localhost.localdomain/44017] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 02:58:21,120 INFO [Listener at localhost.localdomain/44017] regionserver.HRegion(2258): Starting compaction of fe25389ddac66aa7aadc2e3f393d5632/family1 in testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:21,120 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/40f52b922f6342138d1d8d6c533344d4, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/064a974478424d628203f916d5b5cb5f, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/5bb96b17b83d47b8b1f5d5c0db8f142b, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/4c87541f6edc4d3db872c00103a22426, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/877260fadcd44f2e8780760f7ff39fac] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp, totalSize=27.1 K 2023-02-08 02:58:21,121 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 40f52b922f6342138d1d8d6c533344d4, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825091085 2023-02-08 02:58:21,122 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 064a974478424d628203f916d5b5cb5f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825093121 2023-02-08 02:58:21,122 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 5bb96b17b83d47b8b1f5d5c0db8f142b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825095066 2023-02-08 02:58:21,123 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 4c87541f6edc4d3db872c00103a22426, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825097130 2023-02-08 02:58:21,124 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 877260fadcd44f2e8780760f7ff39fac, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 02:58:21,137 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareThroughputController(145): fe25389ddac66aa7aadc2e3f393d5632#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:58:21,580 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302084cb0dfbd773a436ca533e52bad2f2820_del 2023-02-08 02:58:21,580 INFO [Listener at localhost.localdomain/44017] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302084cb0dfbd773a436ca533e52bad2f2820_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302084cb0dfbd773a436ca533e52bad2f2820_del 2023-02-08 02:58:22,441 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3687bd7ec21347dea775009da95e7f4b 2023-02-08 02:58:22,442 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp/family1/3687bd7ec21347dea775009da95e7f4b as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/3687bd7ec21347dea775009da95e7f4b 2023-02-08 02:58:22,460 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3687bd7ec21347dea775009da95e7f4b 2023-02-08 02:58:22,460 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fe25389ddac66aa7aadc2e3f393d5632/family1 of fe25389ddac66aa7aadc2e3f393d5632 into 3687bd7ec21347dea775009da95e7f4b(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:58:22,461 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegion(2288): Compaction status journal for fe25389ddac66aa7aadc2e3f393d5632: 2023-02-08 02:58:22,461 DEBUG [Listener at localhost.localdomain/44017] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 02:58:22,461 DEBUG [Listener at localhost.localdomain/44017] regionserver.HStore(1912): fe25389ddac66aa7aadc2e3f393d5632/family2 is initiating major compaction (all files) 2023-02-08 02:58:22,461 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 02:58:22,461 INFO [Listener at localhost.localdomain/44017] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 02:58:22,461 INFO [Listener at localhost.localdomain/44017] regionserver.HRegion(2258): Starting compaction of fe25389ddac66aa7aadc2e3f393d5632/family2 in testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:22,461 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/df781304b0a642d7a383517818e871f2, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/cf266c99f2014f318dd7e80a6c424e0f, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/e3eb865a8b13466da1b039178efac0ec, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/62f1a5ecd52e4499a4539cc07d5190f8, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/fbf9b2becaf847c8ba79e7fda28fb9d7] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp, totalSize=25.4 K 2023-02-08 02:58:22,462 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting df781304b0a642d7a383517818e871f2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825091085 2023-02-08 02:58:22,462 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting cf266c99f2014f318dd7e80a6c424e0f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825093121 2023-02-08 02:58:22,462 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting e3eb865a8b13466da1b039178efac0ec, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825095066 2023-02-08 02:58:22,463 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 62f1a5ecd52e4499a4539cc07d5190f8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825097130 2023-02-08 02:58:22,463 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting fbf9b2becaf847c8ba79e7fda28fb9d7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 02:58:22,469 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareThroughputController(145): fe25389ddac66aa7aadc2e3f393d5632#family2#compaction#199 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:58:22,513 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/40f52b922f6342138d1d8d6c533344d4, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/064a974478424d628203f916d5b5cb5f, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/5bb96b17b83d47b8b1f5d5c0db8f142b, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/4c87541f6edc4d3db872c00103a22426, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/877260fadcd44f2e8780760f7ff39fac] to archive 2023-02-08 02:58:22,514 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:58:22,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/40f52b922f6342138d1d8d6c533344d4 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/40f52b922f6342138d1d8d6c533344d4 2023-02-08 02:58:22,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/064a974478424d628203f916d5b5cb5f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/064a974478424d628203f916d5b5cb5f 2023-02-08 02:58:22,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/5bb96b17b83d47b8b1f5d5c0db8f142b to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/5bb96b17b83d47b8b1f5d5c0db8f142b 2023-02-08 02:58:22,525 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/4c87541f6edc4d3db872c00103a22426 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/4c87541f6edc4d3db872c00103a22426 2023-02-08 02:58:22,526 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/877260fadcd44f2e8780760f7ff39fac to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/877260fadcd44f2e8780760f7ff39fac 2023-02-08 02:58:22,883 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023020815e2930bb2df410e8c44b1110915f76e_del 2023-02-08 02:58:22,884 INFO [Listener at localhost.localdomain/44017] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020815e2930bb2df410e8c44b1110915f76e_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023020815e2930bb2df410e8c44b1110915f76e_del 2023-02-08 02:58:23,704 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fbf51e48d8084c658ac92b9214b2d18d 2023-02-08 02:58:23,704 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/.tmp/family2/fbf51e48d8084c658ac92b9214b2d18d as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/fbf51e48d8084c658ac92b9214b2d18d 2023-02-08 02:58:23,708 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fbf51e48d8084c658ac92b9214b2d18d 2023-02-08 02:58:23,709 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fe25389ddac66aa7aadc2e3f393d5632/family2 of fe25389ddac66aa7aadc2e3f393d5632 into fbf51e48d8084c658ac92b9214b2d18d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:58:23,709 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegion(2288): Compaction status journal for fe25389ddac66aa7aadc2e3f393d5632: 2023-02-08 02:58:23,709 DEBUG [Listener at localhost.localdomain/44017] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 02:58:23,709 DEBUG [Listener at localhost.localdomain/44017] regionserver.HStore(1912): 1a1069b4442f7236a13b51c4da18e518/family1 is initiating major compaction (all files) 2023-02-08 02:58:23,709 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 02:58:23,709 INFO [Listener at localhost.localdomain/44017] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 02:58:23,711 INFO [Listener at localhost.localdomain/44017] regionserver.HRegion(2258): Starting compaction of 1a1069b4442f7236a13b51c4da18e518/family1 in testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:23,711 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/0388146f423a4db9a121616f8f460c59, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/221fff2fef6c4ca4886116b466e5a295, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/cc4825597b9741938ecb6800c3b2173e, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/accb4e7168e642bf9c565f7f49c87cda, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/40ca91a7e8b54bec82d406df60986cbf] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp, totalSize=27.1 K 2023-02-08 02:58:23,712 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 0388146f423a4db9a121616f8f460c59, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825091084 2023-02-08 02:58:23,712 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 221fff2fef6c4ca4886116b466e5a295, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825093121 2023-02-08 02:58:23,712 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting cc4825597b9741938ecb6800c3b2173e, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825095066 2023-02-08 02:58:23,712 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/df781304b0a642d7a383517818e871f2, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/cf266c99f2014f318dd7e80a6c424e0f, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/e3eb865a8b13466da1b039178efac0ec, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/62f1a5ecd52e4499a4539cc07d5190f8, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/fbf9b2becaf847c8ba79e7fda28fb9d7] to archive 2023-02-08 02:58:23,713 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting accb4e7168e642bf9c565f7f49c87cda, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825097130 2023-02-08 02:58:23,713 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 40ca91a7e8b54bec82d406df60986cbf, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 02:58:23,713 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:58:23,715 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/df781304b0a642d7a383517818e871f2 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/df781304b0a642d7a383517818e871f2 2023-02-08 02:58:23,715 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/cf266c99f2014f318dd7e80a6c424e0f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/cf266c99f2014f318dd7e80a6c424e0f 2023-02-08 02:58:23,716 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/e3eb865a8b13466da1b039178efac0ec to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/e3eb865a8b13466da1b039178efac0ec 2023-02-08 02:58:23,717 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/62f1a5ecd52e4499a4539cc07d5190f8 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/62f1a5ecd52e4499a4539cc07d5190f8 2023-02-08 02:58:23,718 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/fbf9b2becaf847c8ba79e7fda28fb9d7 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family2/fbf9b2becaf847c8ba79e7fda28fb9d7 2023-02-08 02:58:23,721 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareThroughputController(145): 1a1069b4442f7236a13b51c4da18e518#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:58:23,758 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302089b0031fd04fc49ffa1f32d97f2b7f490_del 2023-02-08 02:58:23,759 INFO [Listener at localhost.localdomain/44017] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302089b0031fd04fc49ffa1f32d97f2b7f490_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302089b0031fd04fc49ffa1f32d97f2b7f490_del 2023-02-08 02:58:24,616 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 57edeba00ccf42eba5ee481d598eee7a 2023-02-08 02:58:24,617 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp/family1/57edeba00ccf42eba5ee481d598eee7a as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/57edeba00ccf42eba5ee481d598eee7a 2023-02-08 02:58:24,647 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 57edeba00ccf42eba5ee481d598eee7a 2023-02-08 02:58:24,648 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1a1069b4442f7236a13b51c4da18e518/family1 of 1a1069b4442f7236a13b51c4da18e518 into 57edeba00ccf42eba5ee481d598eee7a(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 02:58:24,648 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegion(2288): Compaction status journal for 1a1069b4442f7236a13b51c4da18e518: 2023-02-08 02:58:24,648 DEBUG [Listener at localhost.localdomain/44017] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 02:58:24,649 DEBUG [Listener at localhost.localdomain/44017] regionserver.HStore(1912): 1a1069b4442f7236a13b51c4da18e518/family2 is initiating major compaction (all files) 2023-02-08 02:58:24,649 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 02:58:24,649 INFO [Listener at localhost.localdomain/44017] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 02:58:24,649 INFO [Listener at localhost.localdomain/44017] regionserver.HRegion(2258): Starting compaction of 1a1069b4442f7236a13b51c4da18e518/family2 in testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:24,649 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/28dff81a8e8c4c23a02ffc16c6287675, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/249a037d4fcd4b9ea02ba58978ee55de, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/f3614b8ff70746f5b7c7b777a1f522fa, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/c4994ff128c148b28f32dffd5095f3ff, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/a0cbe9fd1d1449fb9be52e3cb0179048] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp, totalSize=25.4 K 2023-02-08 02:58:24,649 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 28dff81a8e8c4c23a02ffc16c6287675, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825091084 2023-02-08 02:58:24,650 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 249a037d4fcd4b9ea02ba58978ee55de, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825093121 2023-02-08 02:58:24,650 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting f3614b8ff70746f5b7c7b777a1f522fa, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825095066 2023-02-08 02:58:24,651 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting c4994ff128c148b28f32dffd5095f3ff, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825097130 2023-02-08 02:58:24,651 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting a0cbe9fd1d1449fb9be52e3cb0179048, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 02:58:24,658 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareThroughputController(145): 1a1069b4442f7236a13b51c4da18e518#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:58:24,713 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/0388146f423a4db9a121616f8f460c59, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/221fff2fef6c4ca4886116b466e5a295, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/cc4825597b9741938ecb6800c3b2173e, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/accb4e7168e642bf9c565f7f49c87cda, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/40ca91a7e8b54bec82d406df60986cbf] to archive 2023-02-08 02:58:24,714 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:58:24,717 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/0388146f423a4db9a121616f8f460c59 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/0388146f423a4db9a121616f8f460c59 2023-02-08 02:58:24,720 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/221fff2fef6c4ca4886116b466e5a295 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/221fff2fef6c4ca4886116b466e5a295 2023-02-08 02:58:24,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/cc4825597b9741938ecb6800c3b2173e to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/cc4825597b9741938ecb6800c3b2173e 2023-02-08 02:58:24,725 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/accb4e7168e642bf9c565f7f49c87cda to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/accb4e7168e642bf9c565f7f49c87cda 2023-02-08 02:58:24,728 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/40ca91a7e8b54bec82d406df60986cbf to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/40ca91a7e8b54bec82d406df60986cbf 2023-02-08 02:58:25,064 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302085f05c4aaf3904b3d9afbe3614a4fe996_del 2023-02-08 02:58:25,064 INFO [Listener at localhost.localdomain/44017] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302085f05c4aaf3904b3d9afbe3614a4fe996_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302085f05c4aaf3904b3d9afbe3614a4fe996_del 2023-02-08 02:58:25,887 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 01dfc9c4c6f9401281aa86a55d721bfc 2023-02-08 02:58:25,888 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/.tmp/family2/01dfc9c4c6f9401281aa86a55d721bfc as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/01dfc9c4c6f9401281aa86a55d721bfc 2023-02-08 02:58:25,896 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 01dfc9c4c6f9401281aa86a55d721bfc 2023-02-08 02:58:25,897 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1a1069b4442f7236a13b51c4da18e518/family2 of 1a1069b4442f7236a13b51c4da18e518 into 01dfc9c4c6f9401281aa86a55d721bfc(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:58:25,897 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegion(2288): Compaction status journal for 1a1069b4442f7236a13b51c4da18e518: 2023-02-08 02:58:25,897 DEBUG [Listener at localhost.localdomain/44017] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 02:58:25,897 DEBUG [Listener at localhost.localdomain/44017] regionserver.HStore(1912): c9c0e8bea9bed94731a60f71dbfa6b79/family1 is initiating major compaction (all files) 2023-02-08 02:58:25,897 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 02:58:25,897 INFO [Listener at localhost.localdomain/44017] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 02:58:25,898 INFO [Listener at localhost.localdomain/44017] regionserver.HRegion(2258): Starting compaction of c9c0e8bea9bed94731a60f71dbfa6b79/family1 in testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:25,898 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/db7d1c392d0843058f153bce14590c1c, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/29e24d4aff8e40f788e7b35e52ea989c, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/52a15f5bfa9e4130aa79c90f5717ae21, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/223af425b2d346618891fe8e6cd4a62e, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/a5e83fc0f2744fbda9a8cfc3bc5c57ae] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp, totalSize=27.1 K 2023-02-08 02:58:25,898 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting db7d1c392d0843058f153bce14590c1c, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825091084 2023-02-08 02:58:25,899 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 29e24d4aff8e40f788e7b35e52ea989c, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825093120 2023-02-08 02:58:25,899 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 52a15f5bfa9e4130aa79c90f5717ae21, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825095065 2023-02-08 02:58:25,899 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 223af425b2d346618891fe8e6cd4a62e, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825097129 2023-02-08 02:58:25,900 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting a5e83fc0f2744fbda9a8cfc3bc5c57ae, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 02:58:25,911 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareThroughputController(145): c9c0e8bea9bed94731a60f71dbfa6b79#family1#compaction#202 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:58:25,912 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/28dff81a8e8c4c23a02ffc16c6287675, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/249a037d4fcd4b9ea02ba58978ee55de, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/f3614b8ff70746f5b7c7b777a1f522fa, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/c4994ff128c148b28f32dffd5095f3ff, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/a0cbe9fd1d1449fb9be52e3cb0179048] to archive 2023-02-08 02:58:25,913 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:58:25,914 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/28dff81a8e8c4c23a02ffc16c6287675 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/28dff81a8e8c4c23a02ffc16c6287675 2023-02-08 02:58:25,915 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/249a037d4fcd4b9ea02ba58978ee55de to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/249a037d4fcd4b9ea02ba58978ee55de 2023-02-08 02:58:25,916 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/f3614b8ff70746f5b7c7b777a1f522fa to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/f3614b8ff70746f5b7c7b777a1f522fa 2023-02-08 02:58:25,917 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/c4994ff128c148b28f32dffd5095f3ff to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/c4994ff128c148b28f32dffd5095f3ff 2023-02-08 02:58:25,918 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/a0cbe9fd1d1449fb9be52e3cb0179048 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family2/a0cbe9fd1d1449fb9be52e3cb0179048 2023-02-08 02:58:26,356 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023020826f824c4bd7347de93a2922d9f89cab4_del 2023-02-08 02:58:26,356 INFO [Listener at localhost.localdomain/44017] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020826f824c4bd7347de93a2922d9f89cab4_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020826f824c4bd7347de93a2922d9f89cab4_del 2023-02-08 02:58:27,201 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0e987679b5a246079acdf38bac7aaa36 2023-02-08 02:58:27,202 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp/family1/0e987679b5a246079acdf38bac7aaa36 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/0e987679b5a246079acdf38bac7aaa36 2023-02-08 02:58:27,223 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0e987679b5a246079acdf38bac7aaa36 2023-02-08 02:58:27,224 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c9c0e8bea9bed94731a60f71dbfa6b79/family1 of c9c0e8bea9bed94731a60f71dbfa6b79 into 0e987679b5a246079acdf38bac7aaa36(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:58:27,224 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegion(2288): Compaction status journal for c9c0e8bea9bed94731a60f71dbfa6b79: 2023-02-08 02:58:27,224 DEBUG [Listener at localhost.localdomain/44017] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 02:58:27,224 DEBUG [Listener at localhost.localdomain/44017] regionserver.HStore(1912): c9c0e8bea9bed94731a60f71dbfa6b79/family2 is initiating major compaction (all files) 2023-02-08 02:58:27,224 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 02:58:27,224 INFO [Listener at localhost.localdomain/44017] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 02:58:27,225 INFO [Listener at localhost.localdomain/44017] regionserver.HRegion(2258): Starting compaction of c9c0e8bea9bed94731a60f71dbfa6b79/family2 in testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:27,225 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/989c603dd34e4c3e803b77f96d67f0c7, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/d7452997fc3b4fbca146be6852b53da2, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/7bbcc23a5afe4dc9979404977c51df05, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/e767be0cae32449b947f1e0d83029418, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/29a7e00d7846409f94e8f50c700ad06f] into tmpdir=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp, totalSize=25.4 K 2023-02-08 02:58:27,226 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 989c603dd34e4c3e803b77f96d67f0c7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675825091084 2023-02-08 02:58:27,226 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting d7452997fc3b4fbca146be6852b53da2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675825093120 2023-02-08 02:58:27,226 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 7bbcc23a5afe4dc9979404977c51df05, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675825095065 2023-02-08 02:58:27,227 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting e767be0cae32449b947f1e0d83029418, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675825097129 2023-02-08 02:58:27,227 DEBUG [Listener at localhost.localdomain/44017] compactions.Compactor(207): Compacting 29a7e00d7846409f94e8f50c700ad06f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 02:58:27,234 INFO [Listener at localhost.localdomain/44017] throttle.PressureAwareThroughputController(145): c9c0e8bea9bed94731a60f71dbfa6b79#family2#compaction#203 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 02:58:27,319 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/db7d1c392d0843058f153bce14590c1c, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/29e24d4aff8e40f788e7b35e52ea989c, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/52a15f5bfa9e4130aa79c90f5717ae21, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/223af425b2d346618891fe8e6cd4a62e, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/a5e83fc0f2744fbda9a8cfc3bc5c57ae] to archive 2023-02-08 02:58:27,320 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:58:27,321 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/db7d1c392d0843058f153bce14590c1c to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/db7d1c392d0843058f153bce14590c1c 2023-02-08 02:58:27,322 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/29e24d4aff8e40f788e7b35e52ea989c to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/29e24d4aff8e40f788e7b35e52ea989c 2023-02-08 02:58:27,323 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/52a15f5bfa9e4130aa79c90f5717ae21 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/52a15f5bfa9e4130aa79c90f5717ae21 2023-02-08 02:58:27,324 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/223af425b2d346618891fe8e6cd4a62e to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/223af425b2d346618891fe8e6cd4a62e 2023-02-08 02:58:27,325 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/a5e83fc0f2744fbda9a8cfc3bc5c57ae to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/a5e83fc0f2744fbda9a8cfc3bc5c57ae 2023-02-08 02:58:27,646 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023020886cb58eda0bb44e4ada27198d4fc49eb_del 2023-02-08 02:58:27,646 INFO [Listener at localhost.localdomain/44017] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020886cb58eda0bb44e4ada27198d4fc49eb_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023020886cb58eda0bb44e4ada27198d4fc49eb_del 2023-02-08 02:58:28,474 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ffced66fcc924e6ea1f6ad6def3696de 2023-02-08 02:58:28,475 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/.tmp/family2/ffced66fcc924e6ea1f6ad6def3696de as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/ffced66fcc924e6ea1f6ad6def3696de 2023-02-08 02:58:28,479 INFO [Listener at localhost.localdomain/44017] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ffced66fcc924e6ea1f6ad6def3696de 2023-02-08 02:58:28,480 INFO [Listener at localhost.localdomain/44017] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c9c0e8bea9bed94731a60f71dbfa6b79/family2 of c9c0e8bea9bed94731a60f71dbfa6b79 into ffced66fcc924e6ea1f6ad6def3696de(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 02:58:28,481 DEBUG [Listener at localhost.localdomain/44017] regionserver.HRegion(2288): Compaction status journal for c9c0e8bea9bed94731a60f71dbfa6b79: 2023-02-08 02:58:28,485 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 02:58:28,488 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 02:58:28,493 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 02:58:28,494 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 02:58:28,498 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43477] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10l\xD05zL\xEB\x8Em\xF5\x89\xA3j\x9A\xD9m\xD6"\x10:\xD1`?\xDB?\xAB\xFDO!\x8Ck>\x11\x18\xE5*\x10-_\xD7\xB3\x88\xD8B%;*F\xBA\x0F\xB8\x02\x802\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-02-08 02:58:28,513 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/989c603dd34e4c3e803b77f96d67f0c7, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/d7452997fc3b4fbca146be6852b53da2, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/7bbcc23a5afe4dc9979404977c51df05, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/e767be0cae32449b947f1e0d83029418, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/29a7e00d7846409f94e8f50c700ad06f] to archive 2023-02-08 02:58:28,514 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:58:28,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/989c603dd34e4c3e803b77f96d67f0c7 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/989c603dd34e4c3e803b77f96d67f0c7 2023-02-08 02:58:28,516 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-08 02:58:28,516 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-08 02:58:28,516 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/d7452997fc3b4fbca146be6852b53da2 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/d7452997fc3b4fbca146be6852b53da2 2023-02-08 02:58:28,517 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:58:28,517 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675825708517 2023-02-08 02:58:28,517 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 02:58:28,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/7bbcc23a5afe4dc9979404977c51df05 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/7bbcc23a5afe4dc9979404977c51df05 2023-02-08 02:58:28,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/e767be0cae32449b947f1e0d83029418 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/e767be0cae32449b947f1e0d83029418 2023-02-08 02:58:28,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/29a7e00d7846409f94e8f50c700ad06f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family2/29a7e00d7846409f94e8f50c700ad06f 2023-02-08 02:58:28,810 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-02-08 02:58:28,828 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023020826f824c4bd7347de93a2922d9f89cab4_del 2023-02-08 02:58:28,846 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302089b0031fd04fc49ffa1f32d97f2b7f490_del 2023-02-08 02:58:28,863 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302084cb0dfbd773a436ca533e52bad2f2820_del 2023-02-08 02:58:28,864 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-08 02:58:28,864 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] zookeeper.ReadOnlyZKClient(139): Connect 0x59c61ef8 to 127.0.0.1:49602 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 02:58:28,920 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a857fee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 02:58:28,921 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230208 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-08 02:58:29,868 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208f75ee6f80dd0477d86f4ec01a9b43f42 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230208f75ee6f80dd0477d86f4ec01a9b43f42 2023-02-08 02:58:29,869 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230208 table='testMajorCompactionFromAdmin' column='family1' 2023-02-08 02:58:29,880 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 02:58:29,882 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:48784, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 02:58:29,888 INFO [MobCompactor-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:29,888 INFO [MobCompactor-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:29,889 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 02:58:29,891 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:50670, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 02:58:29,916 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230208/family1/7766b6bc22ca48e391b52aebcc61a9c5 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-08 02:58:29,917 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230208/family1/7766b6bc22ca48e391b52aebcc61a9c5}] 2023-02-08 02:58:29,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230208/family1/7766b6bc22ca48e391b52aebcc61a9c5 for inclusion in c9c0e8bea9bed94731a60f71dbfa6b79/family1 2023-02-08 02:58:29,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-08 02:58:29,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first= last=1 2023-02-08 02:58:29,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for c9c0e8bea9bed94731a60f71dbfa6b79: 2023-02-08 02:58:29,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230208/family1/7766b6bc22ca48e391b52aebcc61a9c5 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionFromAdmin__eksi3rfs563kdbqie0632lcvu929oi8ser02mcmue3omdsu9lect7hak7f70hi8q/family1/7766b6bc22ca48e391b52aebcc61a9c5 2023-02-08 02:58:29,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionFromAdmin__eksi3rfs563kdbqie0632lcvu929oi8ser02mcmue3omdsu9lect7hak7f70hi8q/family1/7766b6bc22ca48e391b52aebcc61a9c5 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/8596900bb38f457289711e7174d25322_SeqId_28_ 2023-02-08 02:58:29,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionFromAdmin__eksi3rfs563kdbqie0632lcvu929oi8ser02mcmue3omdsu9lect7hak7f70hi8q/family1/7766b6bc22ca48e391b52aebcc61a9c5 into c9c0e8bea9bed94731a60f71dbfa6b79/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/8596900bb38f457289711e7174d25322_SeqId_28_ - updating store file list. 2023-02-08 02:58:29,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/8596900bb38f457289711e7174d25322_SeqId_28_ into c9c0e8bea9bed94731a60f71dbfa6b79/family1 2023-02-08 02:58:29,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionFromAdmin__eksi3rfs563kdbqie0632lcvu929oi8ser02mcmue3omdsu9lect7hak7f70hi8q/family1/7766b6bc22ca48e391b52aebcc61a9c5 into c9c0e8bea9bed94731a60f71dbfa6b79/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/family1/8596900bb38f457289711e7174d25322_SeqId_28_) 2023-02-08 02:58:29,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionFromAdmin__eksi3rfs563kdbqie0632lcvu929oi8ser02mcmue3omdsu9lect7hak7f70hi8q/family1/7766b6bc22ca48e391b52aebcc61a9c5 2023-02-08 02:58:29,963 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230208 table='testMajorCompactionFromAdmin' column='family1' 2023-02-08 02:58:29,963 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:58:29,964 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302081aa7af1337b149588182ec6110c37cb3 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302081aa7af1337b149588182ec6110c37cb3 2023-02-08 02:58:29,965 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302087c9ebe22a34143d09059f6a6ac8d53e8 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302087c9ebe22a34143d09059f6a6ac8d53e8 2023-02-08 02:58:29,966 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230208b6e2e5fd89ec494a875a924e84224c69 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230208b6e2e5fd89ec494a875a924e84224c69 2023-02-08 02:58:29,967 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230208e5f38eeefca244abbe9022d92a6b6893 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230208e5f38eeefca244abbe9022d92a6b6893 2023-02-08 02:58:29,967 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-08 02:58:29,967 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230208' 2023-02-08 02:58:29,967 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230208 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-08 02:58:29,967 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230208 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-08 02:58:30,499 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208823cc759b9394c4c9cc5711f2e4a4dea to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230208823cc759b9394c4c9cc5711f2e4a4dea 2023-02-08 02:58:30,499 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230208 table='testMajorCompactionFromAdmin' column='family1' 2023-02-08 02:58:30,514 INFO [MobCompactor-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:30,515 INFO [MobCompactor-pool-1] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:30,558 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230208/family1/71338d92e95b441bbb77fe006bfa5aff first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-08 02:58:30,559 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230208/family1/71338d92e95b441bbb77fe006bfa5aff}] 2023-02-08 02:58:30,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230208/family1/71338d92e95b441bbb77fe006bfa5aff for inclusion in 1a1069b4442f7236a13b51c4da18e518/family1 2023-02-08 02:58:30,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-08 02:58:30,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-08 02:58:30,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for 1a1069b4442f7236a13b51c4da18e518: 2023-02-08 02:58:30,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230208/family1/71338d92e95b441bbb77fe006bfa5aff to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionFromAdmin__g4tpj7kfbnrfs06o2iovcnufi2fkf219un7jckbmskjqjlf7rff4jvq486n7cdb0/family1/71338d92e95b441bbb77fe006bfa5aff 2023-02-08 02:58:30,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionFromAdmin__g4tpj7kfbnrfs06o2iovcnufi2fkf219un7jckbmskjqjlf7rff4jvq486n7cdb0/family1/71338d92e95b441bbb77fe006bfa5aff as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/0762485f1edb4dd5b665330a99c2445b_SeqId_28_ 2023-02-08 02:58:30,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionFromAdmin__g4tpj7kfbnrfs06o2iovcnufi2fkf219un7jckbmskjqjlf7rff4jvq486n7cdb0/family1/71338d92e95b441bbb77fe006bfa5aff into 1a1069b4442f7236a13b51c4da18e518/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/0762485f1edb4dd5b665330a99c2445b_SeqId_28_ - updating store file list. 2023-02-08 02:58:30,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/0762485f1edb4dd5b665330a99c2445b_SeqId_28_ into 1a1069b4442f7236a13b51c4da18e518/family1 2023-02-08 02:58:30,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionFromAdmin__g4tpj7kfbnrfs06o2iovcnufi2fkf219un7jckbmskjqjlf7rff4jvq486n7cdb0/family1/71338d92e95b441bbb77fe006bfa5aff into 1a1069b4442f7236a13b51c4da18e518/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/family1/0762485f1edb4dd5b665330a99c2445b_SeqId_28_) 2023-02-08 02:58:30,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionFromAdmin__g4tpj7kfbnrfs06o2iovcnufi2fkf219un7jckbmskjqjlf7rff4jvq486n7cdb0/family1/71338d92e95b441bbb77fe006bfa5aff 2023-02-08 02:58:30,605 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230208 table='testMajorCompactionFromAdmin' column='family1' 2023-02-08 02:58:30,606 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:58:30,607 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302084c2080d0a64e4ee8bd5fe4480cf356e0 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302084c2080d0a64e4ee8bd5fe4480cf356e0 2023-02-08 02:58:30,608 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020868a65b5f2feb48a3b3d01f376bbc6c19 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020868a65b5f2feb48a3b3d01f376bbc6c19 2023-02-08 02:58:30,609 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302088e1d8950157e442dab08011d7c6ca956 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302088e1d8950157e442dab08011d7c6ca956 2023-02-08 02:58:30,610 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230208e436c55e1ea148d399bf2accdb0b9368 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230208e436c55e1ea148d399bf2accdb0b9368 2023-02-08 02:58:30,610 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-08 02:58:30,610 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230208' 2023-02-08 02:58:30,610 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230208 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-08 02:58:30,610 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230208 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-08 02:58:31,167 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208c28f6af9de044592a21778af2c909810 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230208c28f6af9de044592a21778af2c909810 2023-02-08 02:58:31,168 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230208 table='testMajorCompactionFromAdmin' column='family1' 2023-02-08 02:58:31,186 INFO [MobCompactor-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 02:58:31,186 INFO [MobCompactor-pool-1] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 02:58:31,211 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230208/family1/5a39262b2cd34994bb78c534199819ed first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-08 02:58:31,212 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632., hostname=jenkins-hbase12.apache.org,44577,1675824910652, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230208/family1/5a39262b2cd34994bb78c534199819ed}] 2023-02-08 02:58:31,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230208/family1/5a39262b2cd34994bb78c534199819ed for inclusion in fe25389ddac66aa7aadc2e3f393d5632/family1 2023-02-08 02:58:31,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-08 02:58:31,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-08 02:58:31,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegion(2445): Flush status journal for fe25389ddac66aa7aadc2e3f393d5632: 2023-02-08 02:58:31,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230208/family1/5a39262b2cd34994bb78c534199819ed to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionFromAdmin__48osti6vbbh97nok15euka16psc2sjvl7lfmmo8tnoh3eae3qikcco79mas1fths/family1/5a39262b2cd34994bb78c534199819ed 2023-02-08 02:58:31,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionFromAdmin__48osti6vbbh97nok15euka16psc2sjvl7lfmmo8tnoh3eae3qikcco79mas1fths/family1/5a39262b2cd34994bb78c534199819ed as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/f6cce1cb1279425996c49b3a4b1309c5_SeqId_28_ 2023-02-08 02:58:31,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionFromAdmin__48osti6vbbh97nok15euka16psc2sjvl7lfmmo8tnoh3eae3qikcco79mas1fths/family1/5a39262b2cd34994bb78c534199819ed into fe25389ddac66aa7aadc2e3f393d5632/family1 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/f6cce1cb1279425996c49b3a4b1309c5_SeqId_28_ - updating store file list. 2023-02-08 02:58:31,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/f6cce1cb1279425996c49b3a4b1309c5_SeqId_28_ into fe25389ddac66aa7aadc2e3f393d5632/family1 2023-02-08 02:58:31,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionFromAdmin__48osti6vbbh97nok15euka16psc2sjvl7lfmmo8tnoh3eae3qikcco79mas1fths/family1/5a39262b2cd34994bb78c534199819ed into fe25389ddac66aa7aadc2e3f393d5632/family1 (new location: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/family1/f6cce1cb1279425996c49b3a4b1309c5_SeqId_28_) 2023-02-08 02:58:31,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44577] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/staging/jenkins__testMajorCompactionFromAdmin__48osti6vbbh97nok15euka16psc2sjvl7lfmmo8tnoh3eae3qikcco79mas1fths/family1/5a39262b2cd34994bb78c534199819ed 2023-02-08 02:58:31,260 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230208 table='testMajorCompactionFromAdmin' column='family1' 2023-02-08 02:58:31,260 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:58:31,262 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302083721b4b0661447a09179f806c6610e99 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302083721b4b0661447a09179f806c6610e99 2023-02-08 02:58:31,263 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302085fe4c884cecf405ba0842e898e296c71 to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302085fe4c884cecf405ba0842e898e296c71 2023-02-08 02:58:31,264 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302086d5483d8eec4449581dbcead317841de to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302086d5483d8eec4449581dbcead317841de 2023-02-08 02:58:31,265 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230208bfbe9c18ea4342b19b170769c196e35f to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230208bfbe9c18ea4342b19b170769c196e35f 2023-02-08 02:58:31,265 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-08 02:58:31,265 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230208' 2023-02-08 02:58:31,265 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230208 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-08 02:58:31,265 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-08 02:58:31,266 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-08 02:58:31,266 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020826f824c4bd7347de93a2922d9f89cab4_del] 2023-02-08 02:58:31,266 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:58:31,267 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020826f824c4bd7347de93a2922d9f89cab4_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020826f824c4bd7347de93a2922d9f89cab4_del 2023-02-08 02:58:31,267 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-08 02:58:31,267 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302089b0031fd04fc49ffa1f32d97f2b7f490_del] 2023-02-08 02:58:31,268 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:58:31,269 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302089b0031fd04fc49ffa1f32d97f2b7f490_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302089b0031fd04fc49ffa1f32d97f2b7f490_del 2023-02-08 02:58:31,269 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-08 02:58:31,269 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302084cb0dfbd773a436ca533e52bad2f2820_del] 2023-02-08 02:58:31,269 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 02:58:31,270 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302084cb0dfbd773a436ca533e52bad2f2820_del to hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302084cb0dfbd773a436ca533e52bad2f2820_del 2023-02-08 02:58:31,270 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-08 02:58:31,270 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675824915648] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 02:58:31,271 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-08 02:58:31,272 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.7560 sec 2023-02-08 02:58:31,292 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 02:58:31,294 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 02:58:31,296 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 02:58:31,297 DEBUG [Listener at localhost.localdomain/44017] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 02:58:31,300 INFO [Listener at localhost.localdomain/44017] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 02:58:31,339 INFO [Listener at localhost.localdomain/44017] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=245 (was 252), OpenFileDescriptor=624 (was 637), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=75 (was 95), ProcessCount=174 (was 171) - ProcessCount LEAK? -, AvailableMemoryMB=4023 (was 3209) - AvailableMemoryMB LEAK? - 2023-02-08 02:58:31,339 DEBUG [Listener at localhost.localdomain/44017] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57d271f7 to 127.0.0.1:49602 2023-02-08 02:58:31,340 DEBUG [Listener at localhost.localdomain/44017] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:58:31,340 INFO [Listener at localhost.localdomain/44017] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-08 02:58:31,340 INFO [Listener at localhost.localdomain/44017] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 02:58:31,340 DEBUG [Listener at localhost.localdomain/44017] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x418632d5 to 127.0.0.1:49602 2023-02-08 02:58:31,340 DEBUG [Listener at localhost.localdomain/44017] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:58:31,341 DEBUG [Listener at localhost.localdomain/44017] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-08 02:58:31,341 DEBUG [Listener at localhost.localdomain/44017] util.JVMClusterUtil(257): Found active master hash=517511590, stopped=false 2023-02-08 02:58:31,341 INFO [Listener at localhost.localdomain/44017] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase12.apache.org,43477,1675824909306 2023-02-08 02:58:31,361 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 02:58:31,361 INFO [Listener at localhost.localdomain/44017] procedure2.ProcedureExecutor(629): Stopping 2023-02-08 02:58:31,361 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 02:58:31,361 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 02:58:31,362 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 02:58:31,362 DEBUG [Listener at localhost.localdomain/44017] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x547dc463 to 127.0.0.1:49602 2023-02-08 02:58:31,362 DEBUG [Listener at localhost.localdomain/44017] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:58:31,362 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 02:58:31,362 INFO [Listener at localhost.localdomain/44017] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase12.apache.org,44577,1675824910652' ***** 2023-02-08 02:58:31,362 INFO [Listener at localhost.localdomain/44017] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 02:58:31,362 INFO [RS:0;jenkins-hbase12:44577] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 02:58:31,363 INFO [RS:0;jenkins-hbase12:44577] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 02:58:31,363 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 02:58:31,363 INFO [RS:0;jenkins-hbase12:44577] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 02:58:31,363 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(3304): Received CLOSE for 8e8a02a5b11b2ef4532598feeecb1f4b 2023-02-08 02:58:31,363 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(3304): Received CLOSE for f6afe823b53fe9004da5adcb7d0357b6 2023-02-08 02:58:31,363 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(3304): Received CLOSE for 6629972f379f1aeea9b891f6609ea66f 2023-02-08 02:58:31,363 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(3304): Received CLOSE for 12373e98d6fb3636c0d02a5815aad09c 2023-02-08 02:58:31,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 8e8a02a5b11b2ef4532598feeecb1f4b, disabling compactions & flushes 2023-02-08 02:58:31,363 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(3304): Received CLOSE for fe25389ddac66aa7aadc2e3f393d5632 2023-02-08 02:58:31,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:58:31,363 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(3304): Received CLOSE for 88d8f58a018f7a402bf36777b8b04577 2023-02-08 02:58:31,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:58:31,363 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(3304): Received CLOSE for cbbfde4ca627bec304375d93283fccac 2023-02-08 02:58:31,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. after waiting 0 ms 2023-02-08 02:58:31,363 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(3304): Received CLOSE for 12c23930d7c44fc1708b711f7de5640e 2023-02-08 02:58:31,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:58:31,363 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(3304): Received CLOSE for db39cc04ed2076379d0004c2e09c0e42 2023-02-08 02:58:31,364 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(3304): Received CLOSE for 1a1069b4442f7236a13b51c4da18e518 2023-02-08 02:58:31,364 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(3304): Received CLOSE for 903c5e7f299e5714b7640c3c91b635f1 2023-02-08 02:58:31,364 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(3304): Received CLOSE for 1fe7fcbdd2a405d19a8041aa386a9bde 2023-02-08 02:58:31,364 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(3304): Received CLOSE for 56fee2d3c0105f54ac56ad88bfb2a274 2023-02-08 02:58:31,364 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(3304): Received CLOSE for 164106a360b9b3e7d8a5290e6f851c70 2023-02-08 02:58:31,364 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(3304): Received CLOSE for f95ae31c0549207e908fd449732ddbfb 2023-02-08 02:58:31,364 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(3304): Received CLOSE for 78af5cf8f1dc144d3a534e1053ebf08a 2023-02-08 02:58:31,364 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(3304): Received CLOSE for 7b12968f53863f14d4d88e1e87d68b1d 2023-02-08 02:58:31,364 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(3304): Received CLOSE for 9b6734a6d08c30735bfd45bd3735f0e9 2023-02-08 02:58:31,364 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(3304): Received CLOSE for c01292b5ea9d6f39c163a31c0f80d3d9 2023-02-08 02:58:31,364 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(3304): Received CLOSE for c9c0e8bea9bed94731a60f71dbfa6b79 2023-02-08 02:58:31,364 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(1145): stopping server jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:31,364 DEBUG [RS:0;jenkins-hbase12:44577] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58fb6561 to 127.0.0.1:49602 2023-02-08 02:58:31,364 DEBUG [RS:0;jenkins-hbase12:44577] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:58:31,365 INFO [RS:0;jenkins-hbase12:44577] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 02:58:31,365 INFO [RS:0;jenkins-hbase12:44577] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 02:58:31,365 INFO [RS:0;jenkins-hbase12:44577] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 02:58:31,365 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-08 02:58:31,365 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-02-08 02:58:31,365 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 02:58:31,365 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 02:58:31,365 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 02:58:31,365 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 02:58:31,365 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 02:58:31,365 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=50.62 KB heapSize=78.23 KB 2023-02-08 02:58:31,366 DEBUG [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(1505): Waiting on 12373e98d6fb3636c0d02a5815aad09c, 12c23930d7c44fc1708b711f7de5640e, 1588230740, 164106a360b9b3e7d8a5290e6f851c70, 1a1069b4442f7236a13b51c4da18e518, 1fe7fcbdd2a405d19a8041aa386a9bde, 56fee2d3c0105f54ac56ad88bfb2a274, 6629972f379f1aeea9b891f6609ea66f, 78af5cf8f1dc144d3a534e1053ebf08a, 7b12968f53863f14d4d88e1e87d68b1d, 88d8f58a018f7a402bf36777b8b04577, 8e8a02a5b11b2ef4532598feeecb1f4b, 903c5e7f299e5714b7640c3c91b635f1, 9b6734a6d08c30735bfd45bd3735f0e9, c01292b5ea9d6f39c163a31c0f80d3d9, c9c0e8bea9bed94731a60f71dbfa6b79, cbbfde4ca627bec304375d93283fccac, db39cc04ed2076379d0004c2e09c0e42, f6afe823b53fe9004da5adcb7d0357b6, f95ae31c0549207e908fd449732ddbfb, fe25389ddac66aa7aadc2e3f393d5632 2023-02-08 02:58:31,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8e8a02a5b11b2ef4532598feeecb1f4b/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-08 02:58:31,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:58:31,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 8e8a02a5b11b2ef4532598feeecb1f4b: Waiting for close lock at 1675825111363Running coprocessor pre-close hooks at 1675825111363Disabling compacts and flushes for region at 1675825111363Disabling writes for close at 1675825111363Writing region close event to WAL at 1675825111364 (+1 ms)Running coprocessor post-close hooks at 1675825111367 (+3 ms)Closed at 1675825111368 (+1 ms) 2023-02-08 02:58:31,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675824915812.8e8a02a5b11b2ef4532598feeecb1f4b. 2023-02-08 02:58:31,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing f6afe823b53fe9004da5adcb7d0357b6, disabling compactions & flushes 2023-02-08 02:58:31,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:58:31,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:58:31,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. after waiting 0 ms 2023-02-08 02:58:31,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:58:31,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithMonthlyPolicy/f6afe823b53fe9004da5adcb7d0357b6/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-08 02:58:31,373 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.34 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/.tmp/info/bace3630be884f999399848fea4a49b6 2023-02-08 02:58:31,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:58:31,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for f6afe823b53fe9004da5adcb7d0357b6: Waiting for close lock at 1675825111368Running coprocessor pre-close hooks at 1675825111368Disabling compacts and flushes for region at 1675825111368Disabling writes for close at 1675825111368Writing region close event to WAL at 1675825111369 (+1 ms)Running coprocessor post-close hooks at 1675825111374 (+5 ms)Closed at 1675825111374 2023-02-08 02:58:31,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1675824932351.f6afe823b53fe9004da5adcb7d0357b6. 2023-02-08 02:58:31,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 6629972f379f1aeea9b891f6609ea66f, disabling compactions & flushes 2023-02-08 02:58:31,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f. 2023-02-08 02:58:31,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f. 2023-02-08 02:58:31,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f. after waiting 0 ms 2023-02-08 02:58:31,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f. 2023-02-08 02:58:31,378 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bace3630be884f999399848fea4a49b6 2023-02-08 02:58:31,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/6629972f379f1aeea9b891f6609ea66f/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-08 02:58:31,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f. 2023-02-08 02:58:31,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 6629972f379f1aeea9b891f6609ea66f: Waiting for close lock at 1675825111375Running coprocessor pre-close hooks at 1675825111375Disabling compacts and flushes for region at 1675825111375Disabling writes for close at 1675825111375Writing region close event to WAL at 1675825111375Running coprocessor post-close hooks at 1675825111379 (+4 ms)Closed at 1675825111379 2023-02-08 02:58:31,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1675824960261.6629972f379f1aeea9b891f6609ea66f. 2023-02-08 02:58:31,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 12373e98d6fb3636c0d02a5815aad09c, disabling compactions & flushes 2023-02-08 02:58:31,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:58:31,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:58:31,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. after waiting 0 ms 2023-02-08 02:58:31,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:58:31,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/12373e98d6fb3636c0d02a5815aad09c/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-08 02:58:31,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:58:31,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 12373e98d6fb3636c0d02a5815aad09c: Waiting for close lock at 1675825111380Running coprocessor pre-close hooks at 1675825111380Disabling compacts and flushes for region at 1675825111380Disabling writes for close at 1675825111380Writing region close event to WAL at 1675825111381 (+1 ms)Running coprocessor post-close hooks at 1675825111392 (+11 ms)Closed at 1675825111392 2023-02-08 02:58:31,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1675825021660.12373e98d6fb3636c0d02a5815aad09c. 2023-02-08 02:58:31,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing fe25389ddac66aa7aadc2e3f393d5632, disabling compactions & flushes 2023-02-08 02:58:31,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:31,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:31,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. after waiting 0 ms 2023-02-08 02:58:31,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:31,397 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/.tmp/rep_barrier/3d34c3d85bee44faaaeaf1c7a8f04587 2023-02-08 02:58:31,400 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3d34c3d85bee44faaaeaf1c7a8f04587 2023-02-08 02:58:31,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/fe25389ddac66aa7aadc2e3f393d5632/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-08 02:58:31,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:31,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for fe25389ddac66aa7aadc2e3f393d5632: Waiting for close lock at 1675825111393Running coprocessor pre-close hooks at 1675825111393Disabling compacts and flushes for region at 1675825111393Disabling writes for close at 1675825111393Writing region close event to WAL at 1675825111398 (+5 ms)Running coprocessor post-close hooks at 1675825111402 (+4 ms)Closed at 1675825111403 (+1 ms) 2023-02-08 02:58:31,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1675825088935.fe25389ddac66aa7aadc2e3f393d5632. 2023-02-08 02:58:31,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 88d8f58a018f7a402bf36777b8b04577, disabling compactions & flushes 2023-02-08 02:58:31,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:58:31,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:58:31,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. after waiting 0 ms 2023-02-08 02:58:31,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:58:31,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithWeeklyPolicy/88d8f58a018f7a402bf36777b8b04577/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-08 02:58:31,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:58:31,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 88d8f58a018f7a402bf36777b8b04577: Waiting for close lock at 1675825111403Running coprocessor pre-close hooks at 1675825111403Disabling compacts and flushes for region at 1675825111403Disabling writes for close at 1675825111403Writing region close event to WAL at 1675825111405 (+2 ms)Running coprocessor post-close hooks at 1675825111409 (+4 ms)Closed at 1675825111416 (+7 ms) 2023-02-08 02:58:31,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1675824946956.88d8f58a018f7a402bf36777b8b04577. 2023-02-08 02:58:31,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing cbbfde4ca627bec304375d93283fccac, disabling compactions & flushes 2023-02-08 02:58:31,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:58:31,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:58:31,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. after waiting 0 ms 2023-02-08 02:58:31,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:58:31,420 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/.tmp/table/e4a413eabb554203bf6beccaed19e240 2023-02-08 02:58:31,421 INFO [regionserver/jenkins-hbase12:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-02-08 02:58:31,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyPolicy/cbbfde4ca627bec304375d93283fccac/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-08 02:58:31,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:58:31,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for cbbfde4ca627bec304375d93283fccac: Waiting for close lock at 1675825111416Running coprocessor pre-close hooks at 1675825111416Disabling compacts and flushes for region at 1675825111416Disabling writes for close at 1675825111416Writing region close event to WAL at 1675825111419 (+3 ms)Running coprocessor post-close hooks at 1675825111422 (+3 ms)Closed at 1675825111423 (+1 ms) 2023-02-08 02:58:31,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1675824965434.cbbfde4ca627bec304375d93283fccac. 2023-02-08 02:58:31,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 12c23930d7c44fc1708b711f7de5640e, disabling compactions & flushes 2023-02-08 02:58:31,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:58:31,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:58:31,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. after waiting 0 ms 2023-02-08 02:58:31,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:58:31,424 INFO [regionserver/jenkins-hbase12:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 02:58:31,425 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4a413eabb554203bf6beccaed19e240 2023-02-08 02:58:31,426 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/.tmp/info/bace3630be884f999399848fea4a49b6 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/info/bace3630be884f999399848fea4a49b6 2023-02-08 02:58:31,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/12c23930d7c44fc1708b711f7de5640e/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-08 02:58:31,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:58:31,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 12c23930d7c44fc1708b711f7de5640e: Waiting for close lock at 1675825111423Running coprocessor pre-close hooks at 1675825111423Disabling compacts and flushes for region at 1675825111423Disabling writes for close at 1675825111423Writing region close event to WAL at 1675825111424 (+1 ms)Running coprocessor post-close hooks at 1675825111426 (+2 ms)Closed at 1675825111427 (+1 ms) 2023-02-08 02:58:31,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675824996824.12c23930d7c44fc1708b711f7de5640e. 2023-02-08 02:58:31,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing db39cc04ed2076379d0004c2e09c0e42, disabling compactions & flushes 2023-02-08 02:58:31,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:58:31,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:58:31,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. after waiting 0 ms 2023-02-08 02:58:31,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:58:31,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/db39cc04ed2076379d0004c2e09c0e42/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-08 02:58:31,431 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:58:31,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for db39cc04ed2076379d0004c2e09c0e42: Waiting for close lock at 1675825111427Running coprocessor pre-close hooks at 1675825111427Disabling compacts and flushes for region at 1675825111427Disabling writes for close at 1675825111427Writing region close event to WAL at 1675825111428 (+1 ms)Running coprocessor post-close hooks at 1675825111430 (+2 ms)Closed at 1675825111431 (+1 ms) 2023-02-08 02:58:31,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675824979740.db39cc04ed2076379d0004c2e09c0e42. 2023-02-08 02:58:31,431 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bace3630be884f999399848fea4a49b6 2023-02-08 02:58:31,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 1a1069b4442f7236a13b51c4da18e518, disabling compactions & flushes 2023-02-08 02:58:31,431 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:31,431 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/info/bace3630be884f999399848fea4a49b6, entries=226, sequenceid=130, filesize=37.9 K 2023-02-08 02:58:31,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:31,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. after waiting 0 ms 2023-02-08 02:58:31,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:31,432 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/.tmp/rep_barrier/3d34c3d85bee44faaaeaf1c7a8f04587 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/rep_barrier/3d34c3d85bee44faaaeaf1c7a8f04587 2023-02-08 02:58:31,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/1a1069b4442f7236a13b51c4da18e518/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-08 02:58:31,436 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3d34c3d85bee44faaaeaf1c7a8f04587 2023-02-08 02:58:31,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:31,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 1a1069b4442f7236a13b51c4da18e518: Waiting for close lock at 1675825111431Running coprocessor pre-close hooks at 1675825111431Disabling compacts and flushes for region at 1675825111431Disabling writes for close at 1675825111432 (+1 ms)Writing region close event to WAL at 1675825111432Running coprocessor post-close hooks at 1675825111435 (+3 ms)Closed at 1675825111436 (+1 ms) 2023-02-08 02:58:31,436 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/rep_barrier/3d34c3d85bee44faaaeaf1c7a8f04587, entries=1, sequenceid=130, filesize=5.0 K 2023-02-08 02:58:31,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1675825088935.1a1069b4442f7236a13b51c4da18e518. 2023-02-08 02:58:31,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 903c5e7f299e5714b7640c3c91b635f1, disabling compactions & flushes 2023-02-08 02:58:31,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:58:31,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:58:31,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. after waiting 0 ms 2023-02-08 02:58:31,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:58:31,437 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/.tmp/table/e4a413eabb554203bf6beccaed19e240 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/table/e4a413eabb554203bf6beccaed19e240 2023-02-08 02:58:31,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/903c5e7f299e5714b7640c3c91b635f1/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-08 02:58:31,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:58:31,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 903c5e7f299e5714b7640c3c91b635f1: Waiting for close lock at 1675825111436Running coprocessor pre-close hooks at 1675825111436Disabling compacts and flushes for region at 1675825111436Disabling writes for close at 1675825111436Writing region close event to WAL at 1675825111437 (+1 ms)Running coprocessor post-close hooks at 1675825111444 (+7 ms)Closed at 1675825111445 (+1 ms) 2023-02-08 02:58:31,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1675825021660.903c5e7f299e5714b7640c3c91b635f1. 2023-02-08 02:58:31,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 1fe7fcbdd2a405d19a8041aa386a9bde, disabling compactions & flushes 2023-02-08 02:58:31,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:58:31,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:58:31,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. after waiting 0 ms 2023-02-08 02:58:31,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:58:31,451 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4a413eabb554203bf6beccaed19e240 2023-02-08 02:58:31,451 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/table/e4a413eabb554203bf6beccaed19e240, entries=27, sequenceid=130, filesize=6.6 K 2023-02-08 02:58:31,452 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 87ms, sequenceid=130, compaction requested=false 2023-02-08 02:58:31,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/1fe7fcbdd2a405d19a8041aa386a9bde/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-08 02:58:31,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:58:31,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 1fe7fcbdd2a405d19a8041aa386a9bde: Waiting for close lock at 1675825111445Running coprocessor pre-close hooks at 1675825111445Disabling compacts and flushes for region at 1675825111445Disabling writes for close at 1675825111446 (+1 ms)Writing region close event to WAL at 1675825111451 (+5 ms)Running coprocessor post-close hooks at 1675825111455 (+4 ms)Closed at 1675825111455 2023-02-08 02:58:31,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1675825053524.1fe7fcbdd2a405d19a8041aa386a9bde. 2023-02-08 02:58:31,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 56fee2d3c0105f54ac56ad88bfb2a274, disabling compactions & flushes 2023-02-08 02:58:31,456 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:58:31,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:58:31,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. after waiting 0 ms 2023-02-08 02:58:31,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:58:31,464 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-02-08 02:58:31,465 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 02:58:31,466 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 02:58:31,466 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675825111365Running coprocessor pre-close hooks at 1675825111365Disabling compacts and flushes for region at 1675825111365Disabling writes for close at 1675825111365Obtaining lock to block concurrent updates at 1675825111365Preparing flush snapshotting stores in 1588230740 at 1675825111365Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=51839, getHeapSize=80064, getOffHeapSize=0, getCellsCount=365 at 1675825111366 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675825111366Flushing 1588230740/info: creating writer at 1675825111366Flushing 1588230740/info: appending metadata at 1675825111370 (+4 ms)Flushing 1588230740/info: closing flushed file at 1675825111370Flushing 1588230740/rep_barrier: creating writer at 1675825111378 (+8 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675825111381 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675825111381Flushing 1588230740/table: creating writer at 1675825111400 (+19 ms)Flushing 1588230740/table: appending metadata at 1675825111405 (+5 ms)Flushing 1588230740/table: closing flushed file at 1675825111405Flushing 1588230740/info: reopening flushed file at 1675825111426 (+21 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675825111433 (+7 ms)Flushing 1588230740/table: reopening flushed file at 1675825111442 (+9 ms)Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 87ms, sequenceid=130, compaction requested=false at 1675825111452 (+10 ms)Writing region close event to WAL at 1675825111454 (+2 ms)Running coprocessor post-close hooks at 1675825111465 (+11 ms)Closed at 1675825111466 (+1 ms) 2023-02-08 02:58:31,466 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-08 02:58:31,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/56fee2d3c0105f54ac56ad88bfb2a274/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-08 02:58:31,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:58:31,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 56fee2d3c0105f54ac56ad88bfb2a274: Waiting for close lock at 1675825111456Running coprocessor pre-close hooks at 1675825111456Disabling compacts and flushes for region at 1675825111456Disabling writes for close at 1675825111456Writing region close event to WAL at 1675825111458 (+2 ms)Running coprocessor post-close hooks at 1675825111467 (+9 ms)Closed at 1675825111467 2023-02-08 02:58:31,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1675825053524.56fee2d3c0105f54ac56ad88bfb2a274. 2023-02-08 02:58:31,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 164106a360b9b3e7d8a5290e6f851c70, disabling compactions & flushes 2023-02-08 02:58:31,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70. 2023-02-08 02:58:31,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70. 2023-02-08 02:58:31,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70. after waiting 0 ms 2023-02-08 02:58:31,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70. 2023-02-08 02:58:31,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(2744): Flushing 164106a360b9b3e7d8a5290e6f851c70 1/1 column families, dataSize=109 B heapSize=592 B 2023-02-08 02:58:31,566 DEBUG [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(1505): Waiting on 164106a360b9b3e7d8a5290e6f851c70, 78af5cf8f1dc144d3a534e1053ebf08a, 7b12968f53863f14d4d88e1e87d68b1d, 9b6734a6d08c30735bfd45bd3735f0e9, c01292b5ea9d6f39c163a31c0f80d3d9, c9c0e8bea9bed94731a60f71dbfa6b79, f95ae31c0549207e908fd449732ddbfb 2023-02-08 02:58:31,766 DEBUG [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(1505): Waiting on 164106a360b9b3e7d8a5290e6f851c70, 78af5cf8f1dc144d3a534e1053ebf08a, 7b12968f53863f14d4d88e1e87d68b1d, 9b6734a6d08c30735bfd45bd3735f0e9, c01292b5ea9d6f39c163a31c0f80d3d9, c9c0e8bea9bed94731a60f71dbfa6b79, f95ae31c0549207e908fd449732ddbfb 2023-02-08 02:58:31,842 INFO [regionserver/jenkins-hbase12:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-08 02:58:31,842 INFO [regionserver/jenkins-hbase12:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-08 02:58:31,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/namespace/164106a360b9b3e7d8a5290e6f851c70/.tmp/info/41ecc205bd0445559b38fcab487707cd 2023-02-08 02:58:31,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/namespace/164106a360b9b3e7d8a5290e6f851c70/.tmp/info/41ecc205bd0445559b38fcab487707cd as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/namespace/164106a360b9b3e7d8a5290e6f851c70/info/41ecc205bd0445559b38fcab487707cd 2023-02-08 02:58:31,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/namespace/164106a360b9b3e7d8a5290e6f851c70/info/41ecc205bd0445559b38fcab487707cd, entries=3, sequenceid=7, filesize=4.8 K 2023-02-08 02:58:31,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 164106a360b9b3e7d8a5290e6f851c70 in 420ms, sequenceid=7, compaction requested=false 2023-02-08 02:58:31,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/hbase/namespace/164106a360b9b3e7d8a5290e6f851c70/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-02-08 02:58:31,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70. 2023-02-08 02:58:31,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 164106a360b9b3e7d8a5290e6f851c70: Waiting for close lock at 1675825111467Running coprocessor pre-close hooks at 1675825111467Disabling compacts and flushes for region at 1675825111467Disabling writes for close at 1675825111467Obtaining lock to block concurrent updates at 1675825111468 (+1 ms)Preparing flush snapshotting stores in 164106a360b9b3e7d8a5290e6f851c70 at 1675825111468Finished memstore snapshotting hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70., syncing WAL and waiting on mvcc, flushsize=dataSize=109, getHeapSize=576, getOffHeapSize=0, getCellsCount=3 at 1675825111468Flushing stores of hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70. at 1675825111468Flushing 164106a360b9b3e7d8a5290e6f851c70/info: creating writer at 1675825111468Flushing 164106a360b9b3e7d8a5290e6f851c70/info: appending metadata at 1675825111471 (+3 ms)Flushing 164106a360b9b3e7d8a5290e6f851c70/info: closing flushed file at 1675825111471Flushing 164106a360b9b3e7d8a5290e6f851c70/info: reopening flushed file at 1675825111883 (+412 ms)Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 164106a360b9b3e7d8a5290e6f851c70 in 420ms, sequenceid=7, compaction requested=false at 1675825111889 (+6 ms)Writing region close event to WAL at 1675825111889Running coprocessor post-close hooks at 1675825111893 (+4 ms)Closed at 1675825111893 2023-02-08 02:58:31,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675824913839.164106a360b9b3e7d8a5290e6f851c70. 2023-02-08 02:58:31,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing f95ae31c0549207e908fd449732ddbfb, disabling compactions & flushes 2023-02-08 02:58:31,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb. 2023-02-08 02:58:31,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb. 2023-02-08 02:58:31,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb. after waiting 0 ms 2023-02-08 02:58:31,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb. 2023-02-08 02:58:31,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/f95ae31c0549207e908fd449732ddbfb/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-08 02:58:31,896 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb. 2023-02-08 02:58:31,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for f95ae31c0549207e908fd449732ddbfb: Waiting for close lock at 1675825111893Running coprocessor pre-close hooks at 1675825111893Disabling compacts and flushes for region at 1675825111893Disabling writes for close at 1675825111893Writing region close event to WAL at 1675825111893Running coprocessor post-close hooks at 1675825111896 (+3 ms)Closed at 1675825111896 2023-02-08 02:58:31,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1675824960261.f95ae31c0549207e908fd449732ddbfb. 2023-02-08 02:58:31,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 78af5cf8f1dc144d3a534e1053ebf08a, disabling compactions & flushes 2023-02-08 02:58:31,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:58:31,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:58:31,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. after waiting 0 ms 2023-02-08 02:58:31,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:58:31,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/ns/testMinorCompaction/78af5cf8f1dc144d3a534e1053ebf08a/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-08 02:58:31,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:58:31,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 78af5cf8f1dc144d3a534e1053ebf08a: Waiting for close lock at 1675825111897Running coprocessor pre-close hooks at 1675825111897Disabling compacts and flushes for region at 1675825111897Disabling writes for close at 1675825111897Writing region close event to WAL at 1675825111901 (+4 ms)Running coprocessor post-close hooks at 1675825111905 (+4 ms)Closed at 1675825111905 2023-02-08 02:58:31,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1675825053524.78af5cf8f1dc144d3a534e1053ebf08a. 2023-02-08 02:58:31,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 7b12968f53863f14d4d88e1e87d68b1d, disabling compactions & flushes 2023-02-08 02:58:31,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d. 2023-02-08 02:58:31,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d. 2023-02-08 02:58:31,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d. after waiting 0 ms 2023-02-08 02:58:31,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d. 2023-02-08 02:58:31,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testScannerOnBulkLoadRefHFiles/7b12968f53863f14d4d88e1e87d68b1d/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-08 02:58:31,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d. 2023-02-08 02:58:31,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 7b12968f53863f14d4d88e1e87d68b1d: Waiting for close lock at 1675825111905Running coprocessor pre-close hooks at 1675825111905Disabling compacts and flushes for region at 1675825111905Disabling writes for close at 1675825111905Writing region close event to WAL at 1675825111906 (+1 ms)Running coprocessor post-close hooks at 1675825111908 (+2 ms)Closed at 1675825111908 2023-02-08 02:58:31,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1675824960261.7b12968f53863f14d4d88e1e87d68b1d. 2023-02-08 02:58:31,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 9b6734a6d08c30735bfd45bd3735f0e9, disabling compactions & flushes 2023-02-08 02:58:31,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:58:31,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:58:31,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. after waiting 0 ms 2023-02-08 02:58:31,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:58:31,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testCompactionWithHFileLink/9b6734a6d08c30735bfd45bd3735f0e9/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-08 02:58:31,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:58:31,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 9b6734a6d08c30735bfd45bd3735f0e9: Waiting for close lock at 1675825111909Running coprocessor pre-close hooks at 1675825111909Disabling compacts and flushes for region at 1675825111909Disabling writes for close at 1675825111909Writing region close event to WAL at 1675825111913 (+4 ms)Running coprocessor post-close hooks at 1675825111915 (+2 ms)Closed at 1675825111915 2023-02-08 02:58:31,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1675825021660.9b6734a6d08c30735bfd45bd3735f0e9. 2023-02-08 02:58:31,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing c01292b5ea9d6f39c163a31c0f80d3d9, disabling compactions & flushes 2023-02-08 02:58:31,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:58:31,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:58:31,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. after waiting 0 ms 2023-02-08 02:58:31,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:58:31,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMinorCompactionWithMonthlyPolicy/c01292b5ea9d6f39c163a31c0f80d3d9/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-08 02:58:31,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:58:31,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for c01292b5ea9d6f39c163a31c0f80d3d9: Waiting for close lock at 1675825111916Running coprocessor pre-close hooks at 1675825111916Disabling compacts and flushes for region at 1675825111916Disabling writes for close at 1675825111916Writing region close event to WAL at 1675825111917 (+1 ms)Running coprocessor post-close hooks at 1675825111920 (+3 ms)Closed at 1675825111920 2023-02-08 02:58:31,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1675825073640.c01292b5ea9d6f39c163a31c0f80d3d9. 2023-02-08 02:58:31,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing c9c0e8bea9bed94731a60f71dbfa6b79, disabling compactions & flushes 2023-02-08 02:58:31,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:31,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:31,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. after waiting 0 ms 2023-02-08 02:58:31,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:31,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/data/default/testMajorCompactionFromAdmin/c9c0e8bea9bed94731a60f71dbfa6b79/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-08 02:58:31,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:31,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for c9c0e8bea9bed94731a60f71dbfa6b79: Waiting for close lock at 1675825111920Running coprocessor pre-close hooks at 1675825111920Disabling compacts and flushes for region at 1675825111920Disabling writes for close at 1675825111921 (+1 ms)Writing region close event to WAL at 1675825111921Running coprocessor post-close hooks at 1675825111924 (+3 ms)Closed at 1675825111924 2023-02-08 02:58:31,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1675825088935.c9c0e8bea9bed94731a60f71dbfa6b79. 2023-02-08 02:58:31,966 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(1171): stopping server jenkins-hbase12.apache.org,44577,1675824910652; all regions closed. 2023-02-08 02:58:31,972 DEBUG [RS:0;jenkins-hbase12:44577] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/oldWALs 2023-02-08 02:58:31,972 INFO [RS:0;jenkins-hbase12:44577] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase12.apache.org%2C44577%2C1675824910652.meta:.meta(num 1675824913591) 2023-02-08 02:58:31,975 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/WALs/jenkins-hbase12.apache.org,44577,1675824910652/jenkins-hbase12.apache.org%2C44577%2C1675824910652.1675824912964 not finished, retry = 0 2023-02-08 02:58:32,077 DEBUG [RS:0;jenkins-hbase12:44577] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/oldWALs 2023-02-08 02:58:32,077 INFO [RS:0;jenkins-hbase12:44577] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase12.apache.org%2C44577%2C1675824910652:(num 1675824912964) 2023-02-08 02:58:32,077 DEBUG [RS:0;jenkins-hbase12:44577] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:58:32,077 INFO [RS:0;jenkins-hbase12:44577] regionserver.LeaseManager(133): Closed leases 2023-02-08 02:58:32,078 INFO [RS:0;jenkins-hbase12:44577] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase12:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-08 02:58:32,078 INFO [regionserver/jenkins-hbase12:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 02:58:32,079 INFO [RS:0;jenkins-hbase12:44577] ipc.NettyRpcServer(158): Stopping server on /136.243.104.168:44577 2023-02-08 02:58:32,130 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 02:58:32,130 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase12.apache.org,44577,1675824910652 2023-02-08 02:58:32,130 ERROR [Listener at localhost.localdomain/44017-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@75caacf1 rejected from java.util.concurrent.ThreadPoolExecutor@71f52690[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 02:58:32,130 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase12.apache.org,44577,1675824910652] 2023-02-08 02:58:32,130 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 02:58:32,131 ERROR [Listener at localhost.localdomain/44017-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@25048ff9 rejected from java.util.concurrent.ThreadPoolExecutor@71f52690[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 02:58:32,131 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase12.apache.org,44577,1675824910652; numProcessing=1 2023-02-08 02:58:32,232 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase12.apache.org,44577,1675824910652 already deleted, retry=false 2023-02-08 02:58:32,232 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase12.apache.org,44577,1675824910652 expired; onlineServers=0 2023-02-08 02:58:32,232 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase12.apache.org,43477,1675824909306' ***** 2023-02-08 02:58:32,232 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-08 02:58:32,234 DEBUG [M:0;jenkins-hbase12:43477] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fe5939d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase12.apache.org/136.243.104.168:0 2023-02-08 02:58:32,234 INFO [M:0;jenkins-hbase12:43477] regionserver.HRegionServer(1145): stopping server jenkins-hbase12.apache.org,43477,1675824909306 2023-02-08 02:58:32,234 INFO [M:0;jenkins-hbase12:43477] regionserver.HRegionServer(1171): stopping server jenkins-hbase12.apache.org,43477,1675824909306; all regions closed. 2023-02-08 02:58:32,234 DEBUG [M:0;jenkins-hbase12:43477] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 02:58:32,234 DEBUG [M:0;jenkins-hbase12:43477] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-08 02:58:32,234 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-08 02:58:32,234 DEBUG [M:0;jenkins-hbase12:43477] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-08 02:58:32,235 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.large.0-1675824912663] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.large.0-1675824912663,5,FailOnTimeoutGroup] 2023-02-08 02:58:32,235 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.small.0-1675824912664] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.small.0-1675824912664,5,FailOnTimeoutGroup] 2023-02-08 02:58:32,235 INFO [M:0;jenkins-hbase12:43477] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-08 02:58:32,235 INFO [M:0;jenkins-hbase12:43477] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-08 02:58:32,236 INFO [M:0;jenkins-hbase12:43477] hbase.ChoreService(369): Chore service for: master/jenkins-hbase12:0 had [] on shutdown 2023-02-08 02:58:32,237 DEBUG [M:0;jenkins-hbase12:43477] master.HMaster(1502): Stopping service threads 2023-02-08 02:58:32,237 INFO [M:0;jenkins-hbase12:43477] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-08 02:58:32,238 ERROR [M:0;jenkins-hbase12:43477] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-02-08 02:58:32,239 INFO [M:0;jenkins-hbase12:43477] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-08 02:58:32,239 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-08 02:58:32,256 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-08 02:58:32,256 DEBUG [M:0;jenkins-hbase12:43477] zookeeper.ZKUtil(398): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-08 02:58:32,256 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 02:58:32,256 WARN [M:0;jenkins-hbase12:43477] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-08 02:58:32,256 INFO [M:0;jenkins-hbase12:43477] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-08 02:58:32,257 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 02:58:32,257 INFO [M:0;jenkins-hbase12:43477] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-08 02:58:32,257 DEBUG [M:0;jenkins-hbase12:43477] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 02:58:32,257 INFO [M:0;jenkins-hbase12:43477] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 02:58:32,257 DEBUG [M:0;jenkins-hbase12:43477] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 02:58:32,257 DEBUG [M:0;jenkins-hbase12:43477] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 02:58:32,257 DEBUG [M:0;jenkins-hbase12:43477] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 02:58:32,258 INFO [M:0;jenkins-hbase12:43477] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=513.22 KB heapSize=599.38 KB 2023-02-08 02:58:32,271 INFO [M:0;jenkins-hbase12:43477] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=513.22 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ee982daa1b1b4bb581ae71784f6cbba6 2023-02-08 02:58:32,275 INFO [M:0;jenkins-hbase12:43477] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ee982daa1b1b4bb581ae71784f6cbba6 2023-02-08 02:58:32,276 DEBUG [M:0;jenkins-hbase12:43477] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ee982daa1b1b4bb581ae71784f6cbba6 as hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ee982daa1b1b4bb581ae71784f6cbba6 2023-02-08 02:58:32,280 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 02:58:32,280 INFO [RS:0;jenkins-hbase12:44577] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase12.apache.org,44577,1675824910652; zookeeper connection closed. 2023-02-08 02:58:32,280 ERROR [Listener at localhost.localdomain/44017-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5d90650b rejected from java.util.concurrent.ThreadPoolExecutor@71f52690[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 02:58:32,280 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): regionserver:44577-0x101407e94630001, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 02:58:32,280 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@73c543ad] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@73c543ad 2023-02-08 02:58:32,280 ERROR [Listener at localhost.localdomain/44017-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@55227fa0 rejected from java.util.concurrent.ThreadPoolExecutor@71f52690[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 02:58:32,280 INFO [Listener at localhost.localdomain/44017] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-02-08 02:58:32,281 INFO [M:0;jenkins-hbase12:43477] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ee982daa1b1b4bb581ae71784f6cbba6 2023-02-08 02:58:32,281 INFO [M:0;jenkins-hbase12:43477] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37451/user/jenkins/test-data/d24a4af3-be41-b78a-087b-e25e3596ef17/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ee982daa1b1b4bb581ae71784f6cbba6, entries=123, sequenceid=1011, filesize=33.3 K 2023-02-08 02:58:32,281 INFO [M:0;jenkins-hbase12:43477] regionserver.HRegion(2947): Finished flush of dataSize ~513.22 KB/525540, heapSize ~599.36 KB/613744, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=1011, compaction requested=false 2023-02-08 02:58:32,282 INFO [M:0;jenkins-hbase12:43477] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 02:58:32,282 DEBUG [M:0;jenkins-hbase12:43477] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675825112257Disabling compacts and flushes for region at 1675825112257Disabling writes for close at 1675825112257Obtaining lock to block concurrent updates at 1675825112258 (+1 ms)Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675825112258Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=525540, getHeapSize=613744, getOffHeapSize=0, getCellsCount=1166 at 1675825112258Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675825112259 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675825112259Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675825112264 (+5 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675825112264Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675825112277 (+13 ms)Finished flush of dataSize ~513.22 KB/525540, heapSize ~599.36 KB/613744, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=1011, compaction requested=false at 1675825112282 (+5 ms)Writing region close event to WAL at 1675825112282Closed at 1675825112282 2023-02-08 02:58:32,285 INFO [M:0;jenkins-hbase12:43477] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-08 02:58:32,285 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 02:58:32,286 INFO [M:0;jenkins-hbase12:43477] ipc.NettyRpcServer(158): Stopping server on /136.243.104.168:43477 2023-02-08 02:58:32,327 DEBUG [M:0;jenkins-hbase12:43477] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase12.apache.org,43477,1675824909306 already deleted, retry=false 2023-02-08 02:58:32,456 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 02:58:32,456 INFO [M:0;jenkins-hbase12:43477] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase12.apache.org,43477,1675824909306; zookeeper connection closed. 2023-02-08 02:58:32,456 ERROR [Listener at localhost.localdomain/44017-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1b585246 rejected from java.util.concurrent.ThreadPoolExecutor@213ed1bf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 02:58:32,457 DEBUG [Listener at localhost.localdomain/44017-EventThread] zookeeper.ZKWatcher(600): master:43477-0x101407e94630000, quorum=127.0.0.1:49602, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 02:58:32,457 ERROR [Listener at localhost.localdomain/44017-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@34cd0739 rejected from java.util.concurrent.ThreadPoolExecutor@213ed1bf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 02:58:32,458 WARN [Listener at localhost.localdomain/44017] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 02:58:32,462 INFO [Listener at localhost.localdomain/44017] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 02:58:32,471 WARN [BP-308626503-136.243.104.168-1675824905611 heartbeating to localhost.localdomain/127.0.0.1:37451] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 02:58:32,471 WARN [BP-308626503-136.243.104.168-1675824905611 heartbeating to localhost.localdomain/127.0.0.1:37451] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-308626503-136.243.104.168-1675824905611 (Datanode Uuid 933f9c55-c7d6-4679-9957-54bb32976647) service to localhost.localdomain/127.0.0.1:37451 2023-02-08 02:58:32,474 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/cluster_1ef4d685-639e-f899-0aba-3988a080901f/dfs/data/data1/current/BP-308626503-136.243.104.168-1675824905611] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 02:58:32,474 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/dd0a9a2c-3d97-ce7c-e80e-c19cd50ee511/cluster_1ef4d685-639e-f899-0aba-3988a080901f/dfs/data/data2/current/BP-308626503-136.243.104.168-1675824905611] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 02:58:32,499 INFO [Listener at localhost.localdomain/44017] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-08 02:58:32,629 INFO [Listener at localhost.localdomain/44017] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-08 02:58:32,711 INFO [Listener at localhost.localdomain/44017] hbase.HBaseTestingUtility(1293): Minicluster is down